DEPARTMENT  OF  THE  AIR  FORCE 
AIR  UNIVERSITY 

AIR  FORCE  INSTITUTE  OF  TECHNOLOGY 


jwnttBundSi  sY?~ 


Approved  tor  poblle 

Dtatributfoo  UaMnrftod 


WWteW  JT 

ic  nlniij 
totted 


Wright-Patterson  Air  Force  Base,  Ohio 

89  12 


v  i 


-Jl  » 


AFIT/GE0/ENG/89D-1 


GABOR  TRANSFORMS 
FOR 

FORWARD  LOOKING  INFRARED 
IMAGE  SEGMENTATION 


THESIS 

Kevin  W.  Ayer 
Captain,  USAF 

AFIT/GEO/ENG/89D-1 


DTIC 

ELECTFB5 
DECO  4 19891 

B  1 


Approved  for  public  release;  distribution  unlimited 


AFIT/GEO/ENG/89D-1 


GABOR  TRANSFORMS 
FOR 

FORWARD  LOOKING  INFRARED 
IMAGE  SEGMENTATION 


THESIS 

Presented  to  the  Faculty  of  the  School  of  Engineering 
of  the  Air  Force  Institute  of  Technology 
Air  University 

In  Partial  Fulfillment  of  the 
Requirements  for  the  Degree  of 
Master  of  Science  in  Electrical  Engineering 


Kevin  W.  Ayer,  B.S.,  B.  E.  E. 
Captain,  USAF 


December  1989 


Approved  for  public  release;  distribution  unlimited 


Table  of  Contents 


Page 

Acknowledgements  .  ii 

List  of  Figures  . iii 

List  of  Tables  . vii 

List  of  Equations  . viii 

Abstract  . 1 

I .  Introduction  .  2 


Gabor  filtering  and  its  Relevance  to  Segmentation  ....  2 


Key  Hypothesis  . 5 

Scope  . 5 

Outline  of  Thesis  .  7 


II.  Background  .  8 

Sunniary  of  Fundamental  Concepts  and  Related  Research  .  8 

Mathematical  Justification  of  the  Gabor  Function  ..  8 

Gabor '  s  Original  Work  . . .  12 

M.  R.  Turner's  Work  with 

Modeling  the  Human  Visual  System  .  13 

Daugman's  Work  Using  Gabor  Functions  .  15 

Mallat's  Work  with  "Gabor-like"  Functions  .  16 

Platon  and  Toborg's  Sparse  Filter 

Graphs  for  Image  Recognition  .  18 


III.  Methodology 


General  Approach  and  Methodology  . 

Two  Dimensional  Gabor  Transforms . 

Two  Dimensional  Fast  Fourier  Transforms  . . . . 

Image  Input  . 

Normalization  of  Input  Image  . 

Gabor  Function  Generation  . 

Image  Output  and  Storage  . 

Multiple  Image  Superposition  . 

Labeling  Regions  of  Interest  . 

Computing  "Jets"  Centered  on  Regions  of  Interest 

Recognition  of  Targets  Based  on  "Jets"  . . 

Twenty  Dimensional  Jet  Vector  Approach  . 

Eight  Dimensional  Jet  Vector  Approach  . < 

Kth-Nearest  Neighbor  Network  Approach  . 


24 

25 

27 

28 
28 

28 

Ion  For 

30 

’RAAI 

30 

18 

□ 

35 

:nced 

□ 

36 

3  at  1  OIL. 

37 

37 

40 

v.jtlon/ 

■  t>lllty 

n 

o 

1  o 

■ivail  arui/or 
iDtst  I  Special 

ft  ^ ^ 


IV.  Results  and  Discussion 


41 


Part  1.  Segmentation  . . 41 

General  Discussion  . 41 

Non-Self  Similar  vs.  Self  Similar  .  41 

Cosine  Wave  Variation  vs.  Sine  Wave  Variation  ..  45 

Specific  Discussion  . 51 

Frequency  Variation  . .  51 

Non-Self  Similar  vs.  Self  Similar  .  51 

Cosine  vs.  Sine  . .  56 

Gabor  Size  .  58 

Non-Self  Similar  vs.  Self  Similar  .  59 

Part  2.  Classif ication  .  6? 

Twenty  Dimensional  Jet  Vector  Approach  .  67 

Requirements  for  Classification  .  67 

"Meaningful"  Vector  Component  Value  .  68 

Proper  Thresholding  for  Consistent 

Jet  Locations  .  69 

Sufficient  Dynamic  Range 

of  Vector  Components  .  70 

Bight  Dimensional  Jet  Vector  Approach  .  71 

Data  Setl  (Exemplar  vectors  from  REFM13.PLR)  .  71 

Data  Set2  (Exemplar  vectors  from  REFM14.FLR)  .  75 

Kth-Nearest  Neighbor  Approach  .  81 

Part  3.  Design  of  an  optical  Gabor  transform  system  .  89 

V.  Conclusion  and  Reconaaendations  .  97 

Conclusion  .  97 

Recommendations  .  100 

Digital  Research  .  100 

Modified  Self  Similar  Gabor  Functions  .  100 

Multi-sensor  Fusion  Analog  .  100 

Vector  Space  Warping  for  Classification  .  100 

Neural  Network  Approach  .  102 

Multilayer  Perceptron  .  102 

Optical  Research  . .  103 

Non-linear  Crystals  .  103 

References  .  104 

Appendix  A:  Glossary  of  Terms  .  107 

Appendix  B:  Speech  Signal  Processing  using  MathCAD  .  109 


Appendix  C 

Appendix  D 

Appendix  E 

Appendix  P 

Appendix  G 

Appendix  H 

Appendix  I 

Appendix  J 
Appendix  K 

Appendix  L: 
Appendix  M: 

Appendix  N 

Appendix  0 


i 


Pt  1.  Sine  Wave  Gabor  Transform 

FORTRAN  Source  Code  .  114 

Pt  2.  Cosine  Wave  Gabor  Transform 

FORTRAN  Source  Code  .  114 

Multiple  Image  Superposition 

FORTRAN  Source  Code  .  144 

Regions  of  Interest 

FORTRAN  Source  Code  .  If, 4 

Image  Display 

FORTRAN  Source  Code  .  173 

Jets  Generating 

FORTRAN  Source  Code  .  182 

Jets  Vector  Generating 

FORTRAN  Source  Code  .  192 

MATRIX-X  Code  for  Generating  Minkowski  2  Space 

Distances  .  202 


Making  a  Hard  Copy  of  the  Displayed  Images  . . .  207 

Schematic  of  Gabor  Based  Segmentation  and 


Classification  .  208 

Equipment  and  Resource  Listing  .  210 


Increasing  the  Sinusoidal  Variation  under 

the  Self  Similar  Gaussian  Cofactor  ...  211 


Grossberg's  Boundary  Contour- 

Feature  Contour  System  .  213 

Lambert  preprocessing  of  FLIR  images  .  215 


Vita 


221 


ACKNOWLEDGEMENTS 


I  express  ray  deepest  appreciation  and  gratitude  to  Major  Steve 
Rogers,  Dr.  Matthew  Kabrisky,  Dr.  Mark  Oxley,  and  Captain  Robert 
Williams  for  their  guidance  and  insight  without  which  I'd  surely  be 
gyre  and  gimbling  in  the  wabe. 

I  give  a  very  special  thanks  to  Mike  Roggemann  for  his 
imneasurable  help  in  getting  the  VAX  system  to  jump  through  hoops 
for  me  and  to  Dennis  Ruck  who  helped  me  make  pretty  pictures  out  of 
screen  displays  and  running  all  the  neural  network  gadgets. 

The  list  is  endless,  my  prose  is  not, 
so  I  best  not  be  thanking  the  entire  lot. 

Yet  three  more  I  wish  to  give  thanks  with  a  grin, 
to  my  son,  to  my  daughter,  and  to  my  wife,  Lynn. 

Three  people  so  very  important  to  me, 

They  waited,  and  waited  impatiently. 

Now  the  journey  is  over,  remember  this  quip, 

AFIT  is  truly  Another  Fine  Intellectual  Trip. 

With  no  regrets,  Thank  you  AFIT. 


ii 


its 


List  of  Figures 

Figure  Page 

1.1  Non-self  similar  Gabor  functions  .  3 

1.2  Self  similar  Gabor  functions  .  4 

2.  Jets.  The  hierarchical  "stacking"  of  Gabor  transform 

coefficients  .  20 

3.1  Gabor  segmentation-classification  system  .  26 

3.2  Histogram  of  the  intensity  distribution  of  FLIR  image 

REFK41.FLR  .  32 

3.3  Histogram  of  the  intensity  distribution  of  Gabor  filtered 
image  (FLIR:  REFK41.FLR,  Gabor:  frequency  3,  orientations 

0,  45,  90,  and  135  degrees)  .  34 

4.1  Original  FLIR  image,  REFM13.FLR  .  42 


4.2  Correlations  with  self  similar  Gabor  functions 
(Superposition  of  the  two  dimensional  correlations 
between  raw  FLIR  image  REFM13.FLR  and  self  similar 
Gabor  functions  of  frequency  3  and  orientations 

0,  45,  90,  and  135  degrees)  .  43 

4.3  Correlations  with  non-self  similar  Gabor  functions 
(Superposition  of  the  two  dimensional  correlations 
between  raw  FLIR  image  REFM13.FLR  and  non-self  similar 
Gabor  functions  of  frequency  3  and  orientations 

0,  45,  90,  and  135  degrees)  .  44 

4.4  (a)  Original  FLIR  image  REFJ15.FLR.  (b)  Non¬ 
self  similar  cosine  Gabor  transform  of  FLIR  image  REFJ15.FLR  .  46 

4.5  (a)  REFM13.FLR  with  artificially  added  high  intensity 
blocks  and  specific  cosine  Gabor  functions  (b)  Cosine 

Gabor  transform  of  modified  FLIR  image  REFM13.FLR  . . (a)  47 

(b)  48 


4.6  Sine  wave  Gabor  transform  of  FLIR  image  REFJ15.FLR 
(Superposition  of  the  two  dimensional  correlations 
between  raw  FLIR  image  REFJ15.FLR  and  non-self  similar, 
sine  wave  variation,  Gabor  functions  of  frequency  3 
and  orientations  0,  45,  90,  and  135  degrees)  . 

•  •  • 
in 


L 


49 


4.7  Effects  of  increasing  the  frequency  of  the  ncn-self 
similar  sine  Gabor  sinusoidal  eofactor. 

(a)  Superposition  of  the  two  dimensional  correlations 
between  raw  FLIR  image  REFJ15.FLR  and  non-self  similar 
Gabor  functions  of  orientation  0,  45,  90,  and  135  degrees, 
size  16x16,  frequency  1/16  cycles  per  pixel,  (b)  Super¬ 
position  of  the  two  dimensional  correlations  between  raw 
FLIR  image  REFJ15.FLR  and  non-self  similar  Gabor  functions 
of  orientation  0,  45,  90,  and  135  degrees,  size  16x16, 
frequency  3/16  cycles  per  pixel.  (c)  Superposition  of  the 
two  dimensional  correlations  between  raw  FLIR  image 
REPJ15.FLR  and  non-self  similar  Gabor  functions  of 
orientation  0,  45,  90,  and  135  degrees,  size  16x16, 
frequency  5/16  cycles  per  pixel  .  52 

4.8  Effects  of  increasing  the  frequency  of  the  self 
similar  sine  Gabor  sinusoidal  cofactor. 

(a)  Superposition  of  the  two  dimensional  correlations 
between  raw  FLIR  image  REFJ15.FLR  and  self  similar  Gabor 
functions  of  orientation  0,  45,  90,  and  135  degrees, 
size  16x16,  1  standard  deviation  at  the  maximum  extent. 

(b)  Superposition  of  the  two  dimensional  correlations 
between  raw  FLIR  image  REFJ15.FLR  and  self  similar  Gabor 
functions  of  orientation  0,  45,  90,  and  135  degrees, 
size  16x16,  3  standard  deviations  at  the  maximum  extent. 

(c)  Superposition  of  the  two  dimensional  correlations 
between  raw  FLIR  image  REFJ15.FLR  and  self  similar  Gabor 
functions  of  orientation  0,  45,  90,  and  135  degrees, 

size  16x16,  5  standard  deviations  at  the  maximum  extent  .  55 

4.9  Effects  of  increasing  the  frequency  of  the  non-self 
similar  cosine  Gabor  sinusoidal  cofactor. 

(a)  Superposition  of  the  two  dimensional  correlations 
between  raw  FLIR  image  REFJ15.FLR  and  non-self  similar, 
cosine  variation  Gabor  functions  of  orientations  0,  45,  90, 
and  135  degrees,  size  16x16,  frequency  1/16  cycles  per  pixel. 

(b)  Superposition  of  the  two  dimensional  correlations 
between  raw  FLIR  image  REFJ15.FLR  and  non-self  similar, 
cosine  variation  Gabor  functions  of  orientation  0,  45,  90, 
and  135  degress,  size  16x16,  frequency  3/16  cycles  per  pixel. 

(c)  Superposition  of  the  two  dimensional  correlations 
betv?een  raw  FLIR  image  REFJ15.FLR  and  non-self  similar, 
cosine  variation  Gabor  functions  of  orientation  0,  45,  90, 

and  135  degrees,  size  16x16,  frequency  5/16  cycles  per  pixel  ..  57 


iv 


4.10  Effects  of  changing  the  Gabor  patch  size  for 

non-self  similar  Gabor  transformation  of  PLIR  image  REFM13.FLR. 

(a)  Superposition  of  the  correlations  between  non-self 
similar  Gabor  functions  of  "patch”  size  64x64,  frequency  32, 
orientations  0,  45,  90,  and  135  degrees  with  the  raw 

FUR  image  REPM13.FLR  (four  images  superimposed) 

(b)  Superposition  of  the  correlations  between  non-self 
similar  Gabor  functions  of  "patch"  size  32x32,  frequency  16, 
orientations  0,  45,  90,  and  135  degrees  with  the  raw 

FLIR  image  REFM13.FLR  (four  images  super imposed) . 

(c)  Superposition  of  the  correlations  between  non-self 
similar  Gabor  functions  of  "patch"  size  8x8,  frequency  4, 
orientations  0,  45,  90,  and  135  degrees  with  the  raw 

FLIR  image  REFM13.FLR  (four  images  superimposed)  .  60 

4.11  Effects  of  changing  the  Gabor  patch  size  on  self 
similar  Gabor  transformation  of  PLIR  image  REFM13.FLR. 

(a)  Superposition  of  the  correlations  between  self  similar 
Gabor  functions  of  "patch"  size  64x64,  frequency  1, 
orientations  0,  45,  90,  and  135  degrees  with  the  raw 

PLIR  image  REFM13.FLR  (four  images  superimposed). 

(b)  Superposition  of  the  correlations  between  self  similar 
Gabor  functions  of  "patch"  size  32x32,  frequency  1, 
orientations  0,  45,  90,  and  135  degrees  with  the  raw 

FLIP,  image  REFM13.FLR  (four  images  superimposed). 

(c)  Superposition  of  the  correlations  between  non-self 
similar  Gabor  functions  of  "patch"  size  8x8,  frequency  1, 


orientations  0,  45,  90,  and  135  degrees  with  the  raw 

FLIR  image  REFM13.FLR  (four  images  superimposed)  .  63 

4.12  Wavefront  Reconstruction:  Holography. 

(a)  Creating  the  interf erogram.  (b)  Reconstructing 

the  hologram  . . .  92 


4.13.  Schematic  of  proposed  optical  Gabor  transform  system  ..  94 


AM-1.  Effect  of  increasing  the  number  of  cycles  under  the 
Gaussian  envelope  of  a  self  similar  Gabor  function  .  211 

AO-1.  Effects  of  "Lambertizing"  FLIR  image  REFK41.FLR. 

The  top  image  is  the  original  FLIR.  The  bottom  image 

is  the  Lambert  version  . . .  216 

A0-2.  Gabor  transformation  of  "Lambertized"  version  of 

FLIR  image  REFK41.FLR  (Frequency:  3,  Orientations:  0  and 

90  degrees)  .  217 


v 


AO-3.  (a)  Lambert izat ion  of  test  image  possessing 

varying  intensity  rectangles,  (b)  Original  test  image 


218 


AO-4,  (a)  Gabor  transform  of  FLIR  image  REFK41.FLR  (no 

preprocessing),  (b)  Gabor  transform  of  FLIR  image 

REFK41 . FLR  (after  Lambertization)  .  220 


vi 


List  of  Tables 


Table  Page 

1.  Bin  number  relative  to  pixel  value  range  .  31 

2a.  Euclidean  distances  between  exemplar  and  test  vectors 

(Exemplar:  REFM13.FLR,  Test:  REFM17.FLR)  .  72 

2b.  Figure  of  Merit  associated  with  Data  in  Table  2a  .  73 

3a.  Euclidean  distances  between  exemplar  and  test  vectors 

(Exemplar:  REFM14.FLR,  Test:  REFM13.PLR)  .  76 

3b.  Figure  of  Merit  associated  with  Data  in  Table  3a  .  78 

3c.  Performance  of  jet  vector  recognition  using 

five  specifically  located  jets  .  79 

4.  Confusion  matrix  for  fifth  nearest  neighbor  calculations  .  82 

5.  Nearest  neighbor  accuracies  for  eight  vector  component 
input,  four  vector  component  input  (16  by  16),  four 

vector  component  input  (8  by  8)  86 


vn 


List  of  Equations 

Equations  Page 

1.  (a)  The  Gabor  Transform  Integral,  (b)  The  Gabor 

Transform  Kernel .  (c)  Normalized,  Spatially  Shifted 

Gaussian  Functions  .  8 

2.  (a)  Pourier  transform  pair  for  convolution. 

(b)  Pourier  transform  pair  for  correlation  .  9 

3.  One  dimensional  Gaussian  whose  center  resides  at  t'  ....  10 

4.  Inner  product  of  the  Gabor  function  .  11 

5.  Plancherel's  Theorem  (21)  .  11 

6.  Inverse  Gabor  transform  convolution  integral  .  11 

7.  Platon  and  Toborg's  saliency  metric  .  21 

8.  Vector  Normalization  Rule  .  37 

9.  Euclidean  Distance  Rule  .  38 

10.  Pigure  of  Merit  for  distances  .  39 

11.  Complex  field,  Unknown  Wavefront  .  89 

12.  Complex  field,  K  -lerence  Wavefront  .  90 

13.  Intensity  of  interference  pattern,  unknown  wavefront 

and  reference  wavefront  . . .  90 

14.  Transmission  wavefront  .  91 

15.  Scaled  version  of  unknown  wavefront  .  91 

16.  Relationship  producing  the  Lambert  effect  .  215 


V1H 


Abstract 


This  research  investigated  the  difficult  task  of  segmenting 
targets  in  cluttered  PLIR  images.  This  research  initiated 
investigation  into  classifying  the  segmented  targets  based  on  the 
same  method  used  for  segmentation.  The  primary  means  for  segmenting 
and  classifying  targets  was  the  biologically  motivated  use  of  Gabor 
transforms . 

This  research  successfully  produced  a  complete  segmentation 
system  based  on  correlations  between  PLIR  images  and  non-self 
similar  or  modified  self  similar  Gabor  functions. 

Initial  investigation  into  methods  for  recognition  of  targets 
and  their  detailed  sub-structures  was  accomplished  using  self 
similar  and  modified  self  similar  Gabor  transform  correlation 
coefficients  "stacked"  in  jets.  Nearest  neighbor  recognition  using 
the  jets  method  produced  accuracy  of  0.622.  Nearest  neighbor 
recognition  of  targets  using  jets  for  input  to  a  k-nearest  neighbor 
network  produced  final  accuracy  of  0.6214  (for  calculations  based 
on  seven  nearest  neighbors).  An  optical  Gabor  transform  design  is 
introduced  to  implement  the  computation  of  the  Gabor  coefficients. 

-  /  '  •  / 
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I •  Introduction 


The  United  States  Air  Force  is  actively  pursuing  research  in 
image  processing  in  an  effort  to  reliably  detect,  recognize,  and 
classify  targets.  However,  a  fundamental  problem  with  target 
detection  is  segmentation  or  finding  possible  targets  in  highly 
cluttered  images. 

The  concept  of  separating  one  object  from  another  is  as  common 
to  humans  as  breathing.  We  constantly  manipulate  our  environment 
to  suit  our  needs,  whether  we  physically  change  the  environment 
(actually  move  or  remove  objects  within  our  environment)  or  simply 
change  the  way  we  perceive  or  observe  the  environment. 

Often,  we  cannot  physically  alter  the  environment  in  which  a 
target  resides,  short  of  destroying  the  target  and  its  surroundings. 
Therefore,  we  attempt  to  observe  the  target  in  its  surroundings. 
We  must  separate  the  target  from  the  rest  of  the  image  to  observe 
or  detect  the  target.  Distinguishing  targets  from  background  is 
referred  to  as  segmentation. 

Gabor  filtering  and  its  relevance  to  segmentation.  One  method 
for  segmenting  images  uses  texture  as  the  discriminating  feature. 
Since  Gabor  filtering  provides  energy  localization  coupled  with 
textural  discrimination,  it  will  be  investigated  as  a  biologically 
motivated  alternative  to  heuristic  segmentation  schemes.  There  is 


2 


evidence  which  suggests  that  the  visual  cortex  of  cats  react  to 
stimuli  much  the  same  way  as  Gabor  functions,  or  "Gabor-like" 
functions  process  information  (1221233-1258). 

The  Gabor  function  is  comprised  of  two  cofactors.  The  first 
cofactor  is  the  Gaussian  envelope.  The  Gaussian  envelope  provides 
localization  of  correlated  energy.  The  second  cofactor  is  the 
sinusoidal  variation  over  which  the  Gaussian  cofactor  is 
superimposed.  The  sinusoidal  cofactor  provides  the  textural,  or 
frequency,  discrimination. 


Figure  1.1.  Non-self  similar  Gabor  functions.  The  top 
row  are  sine  Gabor  functions.  The  bottom  row  are 
cosine  Gabor  functions. 
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If  the  sinusoidal  variation  is  independent  of  the  Gaussian 
standard  deviation,  the  Gabor  function  is  said  to  be  non-self 
similar  (Pigure  1.1).  Figure  1.1  shows  one,  three,  and  five  cycle 
non-self  similar  sine  and  cosine  Gabor  functions. 

If  the  sinusoidal  variation  is  a  function  of  the  Gaussian 
standard  deviation,  the  Gabor  function  is  said  to  be  self  simxlar 
(Figure  1.2).  Pigure  1.2  shows  sine  and  cosine  self  similar  Gabor 
functions  possessing  one ,  three,  and  five  standard  deviations  at  the 
N/2  point. 


Figure  1.2.  Self  similar  Gabor  functions.  The  top  row 
are  sine  Gabor  functions.  The  bottom  row  are  cosine 
Gabor  functions. 
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When  the  sinusoidal  variation  is  allowed  to  rotate  in-plane 
with  respect  to  the  radially  symmetric  Gaussian  envelope,  the  Gabor 
function  becomes  more  specific  in  its  "matched"  filter 
characteristics.  Specific  spatial  frequencies  and  spatial 
orientations  are  chosen  to  "match"  expected  target  characteristics. 

Key  Hypothesis.  The  fundamental  hypothesis  of  this  research 
is  that  Pourier  transform  theory  is  applicable  to  image 
segmentation,  thus  restricting  the  analysis  to  linear  image 
processing  techniques. 

Several  heuristic  approaches  have  been  taken  to  effectively 
segment  targets  from  background  (2:MS  Thesis,  ll:MS  Thesis,  18:280- 
286,  20:18  pages).  These  heuristic  approaches  use  non-linear 
mathematical  manipulation  of  data  which  are  not  readily  accomplished 
optically;  hence,  these  approaches  are,  invariably,  computationally 
intense.  If  Pourier  transformation,  or  an  appropriate  analog  of  the 
Fourier  transformation,  is  a  viable  approach,  the  implementation  of 
Gabor  filtering  using  linear  Fourisr  optic  techniques  should  be 
possible  to  offset  the  intense  computational  effort. 

Scone.  The  first  sujor  goal  of  this  research  is  to  develop 
the  simulation  code  for  generating  Giabor  filters.  The  second  goal 
of  this  research  is  to  analyze  the  Gabor  filter  for  its  ability  to 
segment  Forward  Looking  InfraRed  (PLIR)  images.  From  the  results 
of  the  segmentation,  the  last  goal  of  this  research  is  to  provide 
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a  preliminary  feasibility  study  on  the  use  of  Gabor  coefficients  as 
a  means  to  classify  PLIR  targets.  The  requirements  necessary  for 
optically  generating  Gabor  correlations  are  also  investigated. 

This  research  begins  with  a  study  into  the  fundamental 
understanding  of  time  based  self  similar  Gabor  transforms  for 
dilations  corresponding  to  near  octave  frequencies  of  S3. 89  Hz. 
107.79  Hz,  215.58  Hz.  431.16  Hz,  862.32  Hz,  1638.40  Hz,  3276.80  Hz, 
8192  Hz,  and  16384  Hz  as  they  apply  to  one  dimensional  speech  signal 
processing.  From  this  understanding  of  how  Gabor  transforms  work, 
the  research  extends  to  two  dimensional  analysis  of  Gabor  transforms 
of  Forward  Looking  InfraRed  (FLIR)  images.  Self  similar  versus  non¬ 
self  similar  Gabor  transforms  at  frequencies  corresponding  to  1,  2, 
3,  4,  and  5  cycles  and  orientations  of  0,  45,  90,  and  135  degrees 
at  each  frequency  were  investigated  using  a  digital  simulation 
algorithm  developed  for  this  research.  The  digital  simulation 
portion  of  this  research  produced  a  complete  segmentation  system 
using  Gabor  "filters".  A  preliminary  feasibility  study  of  the  Gabor 
coefficients  classification  system  based  on  jets  as  described  by 
Platon  and  Toborg  (5:1313-1320)  was  also  conducted.  The  research 
also  investigated  the  requirements  needed  to  optically  generate 
Gabor  transforms  for  image  processing. 
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Outline  of  Thesis.  Chapter  II  discusses  fundamental  concepts 
involved  with  the  Gabor  function,  Gabor's  original  papers,  and 
reviews  recent  work  in  the  area  of  image  segmentation  and 
classification  based  on  Gabor  functions.  The  APIT-developed  Gabor 
based  FLIR  segmenter/classif ier  is  described  in  Chapter  III  with 
discussion  of  results  in  Chapter  IV.  A  conclusion  and 
recommendations  for  further  research  are  included  in  Chapter  V. 


7 


II.  Background 

S'uimarv  of  Fundamental  Concepts  and  Related  Research. 

Mathematical  Justif ication  of  the  Gabor  Punetion.  If  the 
spatial  variables  x  and  y,  and  their  respective  spatial  frequencies, 
a  and  B,  are  functionally  independent,  then  the  form  of  the  two 
dimensional  Gabor  transform  is  the  correlation  integral  whose 
cosines  and  sines  have  been  modified  by  the  Gaussian  distribution 

P(x,y,a.a)  =  ^•*’4’a>0t\y’)  dx’dy'  (la) 

where 

g(x,y,M)(x',y')  =  eittx/20ei8y/2oe-iax'/2oe-iBy'/20g(x'_x)g(y '_y)  (lb) 

and 

g(x'-x)  =  NORM  exp(-(x'-x)*/2o2)  NORM  =  normalization  constant 
g(y'-y)  =  NORM  exp(-(y’-y)2/2o2).  (lc) 

The  function  f(x',y')  is  the  original  two  dimensional  input 
image.  The  function  F(x,y,a,B )  is  the  two  dimensional  output  image, 
the  Gabor  transform  of  the  input  image.  The  Gabor  function, 
g(*.Y  >M)(X-,y-),  is  the  two  dimensional,  modified  complex  sinusoid 
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whose  frequency  variables,  a  and  B,  are  related  to  the  standard 
deviation  of  the  Gaussian  functions. 

The  relationship  given  in  equation  1  displays  all  possible 
shifts  for  a  given  x’  and  y’  hence  the  notation  (x,y,a,B)  for  the 
correlation  integral.  The  Gabor  transform  represents  the 
correlation  between  the  Gabor  function  and  a  particular  two 
dimensional  signal.  The  correlation  between  the  input  signal  and 
the  particular  Gabor  function  of  interest  can  be  obtained  by 
multiplying  the  Fourier  transform  of  the  image  with  the  Fourier 
transform  (complex  conjugate  of  the  Fourier  transform)  of  the  Gabor 
function.  Recall, 


f  *  g  <— >  F  •  G  (2a) 

f  *  g  <_>  p  .  G*  (2b) 

where  *  denotes  convolution,  ^  denotes  correlation  and  *  denotes 
complex  conjugate  (8:1-287). 

Therefore,  theoretically,  Fourier  transforming  the  input 
signal  and  the  Gabor  function,  multiplying  the  Fourier  transform  of 
the  input  signal  with  the  complex  conjugate  of  Fourier  transform  of 
the  Gabor  function,  then  inverse  Fourier  transforming  the  product 
will  result  in  the  correlation  between  the  particular  Gabor  function 
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of  interest  and  the  original  space  domain  representation  of  the 
input  signal.  Realize  that  the  output  image  from  the  inverse 
Fourier  transform  will  be  flipped  about  both  the  x  and  y  axes 
relative  to  the  input  image. 

A  more  generalized  mathematical  discussion  of  the  class  of 
functions  to  which  the  Gabor  function  belongs  can  be  found  in  a 
paper  by  Grossmann  and  Morlet  (10:723-736). 

Grossmann  and  Morlet' s  discussion  of  square  integrable 
functions,  which  includes  the  Gabor  function  and  its  functional 
form,  namely  its  Fourier  transform  analog,  presents  the  generalized 
mathematical  foundation  for  using  the  functional  form  of  the  Gabor 
function. 

The  reader  should  be  aware  of  the  notational  changes  and  that 
the  arguments  presented  are  derived  for  one  dimensional  Gabor 
transforms . 

According  to  Grossmann  and  Morlet,  an  arbitrary  complex-valued 
square  integrable  function  s(t)  can  be  represented  by  Gaussians, 
shifted  in  both  the  spatial  and  spatial  frequency  domains.  If 
g(t)=2-'/V«.-W2 

t',  Q '  are  arbitrary  real  variables,  then 

,(tM,)(t)=.«'‘VJ.-i«'Wl,(t-f)  (3) 
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where  g(t-t')  =  2 ^2exp(-(t-t '  )2/2)  is  a  normalized,  one 
dimensional  Gaussian  which  forms  the  inner  product  (dot  product) 
between  the  square  integrable  function  and  the  input 


S(t\Q') 


■Ha 

[s(t)g^  Ut)  dt 


(4) 


By  definition,  the  integral  over  all  space  for  the  magnitude  of  the 
given  function,  |g|,  is  unity,  hence 


|S(t'  .O^dt’dC’ 


|  |S(t)j2dt 
R 


(5) 


In  other  words,  the  energy  within  the  Gabor  transform  is  that  which 
is  derived  from  the  energy  within  the  image. 

The  function  s(t)  can  be  recovered  from  the  function  S(t' ,2') 
through 


a(t) 


S(t\8,)g*t’’#,><t)  dt ' dO ' 


(6) 


which  represents  the  inverse  Gabor  transform. 
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Through  close  inspection,  the  form  of  the  square  integrable 
transform  as  described  by  Grossmann  and  Morlet  and  that  found  in 
equation  1  produce  the  same  mathematical  results 


P(x,y,a,B) 


y 

\L 


f(x'.y')  g(*>y>a«a)(x'  (y’ )  dx’dy’ 


(1) 


S(t'.Q') 


L(t)g(t’,fl’)(t)  dt 

R2 


(4) 


Letting  t’  equal  X,  2'  equal  a,  S  equal  P,  and  extending  the 
relationship  in  equation  4  to  two  dimensions  by  introducing  y'  and 
B,  equation  4  becomes  identical  to  equation  1. 

Hence,  the  form  of  the  Gabor  transform  is  the  correlation 
integral  which  is  a  member  of  an  entire  class  of  functions,  the 
square  integrable  functions,  producing  transforms  that  may  be  useful 
for  image  processing. 


Gabor's  Original  Work.  The  basic  concept  of  multivariate 
frequency  analysis  was  developed  by  Dennis  Gabor  in  1946.  During 
the  postwar  decade,  the  ability  to  compress  large  amounts  of 
information  into  fixed  frequency  bands  was  crucial  for  the 
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advancement  of  communications.  In  his  three  part  paper.  Gabor 
discussed  how  to  compress  and  expand  information  to  transmit  over 
communication  channels  in  an  effort  to  optimize  frequency  band  use. 

Based  on  available  experimental  data,  Gabor  noted  that  human 
hearing  loses  its  efficiency  to  discriminate  frequencies  beyond  1000 
Hz,  "...  proving  that  sound  reproductions  which  are  far  from 
faithful  may  be  perceived  by  the  ear  as  perfect,  and  that  condensed 
methods  of  transmission  and  reproduction  with  improved  waveband 
economy  are  possible  in  principle.” 

Gabor  developed  two  means  of  compressing  data  for  transmission 
over  communications  channels.  Both  approaches  used  a  Gaussian 
envelope  possessing  a  sinusoidal  carrier  whose  frequency  of 
variation  was  a  direct  function  of  the  Gaussian  standard  deviation. 
By  functionally  linking  the  frequency  to  the  Gaussian  standard 
deviation,  Gabor  was  able  to  produce  a  single  function  that 
possessed  highly  specific,  tunable  frequencies  for  speech 
compression  and  expansion  [  This  type  of  Gabor  function  is  commonly 
called  self  similar,  which  possess  a  fixed  number  of  periods  within 
the  Gaussian  envelope  ]  (6:429-457). 

M.  R.  Turner's  work  witft  modeling  the  human  visual  system. 
Prom  Gabor’s  work  with  multivariate  frequency  analysis,  M.  R.  Turner 
developed  a  model  for  the  human  visual  system.  Turner  described  the 
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problem  of  modeling  the  visual  system  as  one  of  information 
representation.  Both  che  single  valued  pixel  representation  and  the 
Fourier  transform  representation  provide  complete  image  information. 
However,  the  pixel  representation  did  not  emphasize  information 
about  the  patterns  contained  within  the  set  of  pixels,  such  as 
periodicity  and  structural  distribution.  The  Fourier  transform 
representation  did  not  emphasize  local  gradients  (distributions). 
Hence,  the  Fourier  transform  was  not  an  efficient  means  of  local 
textural  discrimination  since  it  could  not  faithfully  reproduce  fine 
structural  detail,  localized  gradients. 

The  key,  according  to  Turner,  was  to  develop  a  method  to 
represent  the  image  completely  in  space  and  in  frequency.  Turner 
employed  the  Gabor  function  to  provide  a  means  to  accomplish  this 
task.  Instead  of  using  self  similar  Gabor  functions,  where  the 
sinusoidal  variation  was  directly  proportional  to  the  standard 
deviation  of  the  Gaussian  envelope.  Turner  used  a  constant  Gaussian 
distribution  and  varied  the  sinusoidal  frequency,  the  non-self 
similar  Gabor  function.  By  employing  a  non-self  similar  Gabor 
function,  Turner  was  able  to  optimally  display  detailed  textural 
features  without  sacrificing  global  features  such  as  periodicity  and 
overall  data  structure  (23:71-82). 
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Daugman ' s  work  using  Gabor  functions.  In  1988,  John  Daugman 
developed  a  neural  network  implementation  of  Gabor  transforms  for 
data  reduction  and  image  segmentation.  As  in  Turner's  work,  Daugman 
expressed  the  need  to  explicitly  represent  features  required  to 
completely  characterize  a  signal. 

Daugman  discussed  three  levels  of  image  processing  and  related 
them  to  orders  of  correlation.  Processing  locally  similar  pixels 
corresponded  to  first  order  correlation,  or  low  level  correlation. 
Processing  spatially  continuous  edges  corresponded  to  second  order 
correlation,  or  a  level  of  correlation  producing  localized 
structural  information.  Processing  uniformly  distributed  frequency 
corresponded  to  high  order  correlation,  or  global  structural 
information  processing.  In  other  words,  the  level  of  correlation 
increases  as  the  processing  of  the  image  becomes  more  and  more 
global . 

Daugman  used  the  Gabor  transform  function  because  it  provided 
the  vehicle  for  extracting  local  spectral  information  (texture  and 
form)  while  retaining  information  about  the  global  "patterns"  or 
textures  of  the  image.  Localization  of  information  is  accomplished 
through  the  "windowing"  effect  caused  by  the  Gaussian  envelope. 
Global  textural  information  retrieval  is  accomplished  using  specific 
sinusoidal  frequencies  and  orientations  which  "match"  the  global 
textural  distribution. 
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Daugman  described  two  methods  for  generating  Gabor  functions. 
The  first  method  generated  a  constant  Gaussian  standard  deviation 
with  a  varying  sinusoid  carrier.  This  type  of  Gabor  function,  based 
on  Bastiaan's  use  of  biorthogonal  functions  (1:538-539),  and  known 
as  a  non-self  similar  Gabor  function,  differs  from  the  self  similar 
Gabor  function  as  described  by  Gabor  in  that  the  sinusoidal 
variation  is  not  a  function  of  the  standard  deviation  of  the 
Gaussian  envelope  (see  Figure  1.1  and  1.2  for  examples  of  non-self 
similar  and  self  similar  Gabor  functions).  The  non-self  similar 
method  allowed  Daugman  to  "search"  the  entire  image  for  local 
texture  differences  to  find  regions  of  highest  probability  for 
object  location.  The  second  method,  the  self  similar  Gabor 
transform  method,  allowed  Daugman  to  concentrate  computational 
effort  on  specific  regions  of  the  image  to  better  define  the 
textural  content  of  that  region  (4:1169-1179). 

Mallat's  work  with  "Gabor-like"  functions.  Mallat  studied  the 
properties  of  a  set  of  wavelet  functions  belonging  to  the  L2(Rn,R) 
class  of  functions.  The  L2(Rn,R)  class  includes  all  square 
integrable  functions  such  as  the  Gabor  function  as  well  as  Mallat's 
orthonormal  basis  set  of  wavelets. 

The  decomposition  of  Mallat's  wavelets  using  the  square 
integrable  function  set  defines  the  orthogonal  multiresolution 
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representation  (wavelet  representation) .  The  important  feature  of 
Mallat's  wavelet  representation  ia  its  orthogonality  since  Gabor 
transforms  do  not  constitute  a  complete,  orthogonal  set  of  basis 
functions.  Orthogonality  implies  non-redundancy  in  the  transform 
output  and  also  affords  the  ability  to  formally  derive  a  sampling 
theorem  based  on  the  orthogonal  set  of  functions. 

Mallat’s  pyramidal  algorithm,  which  is  based  primarily  on  the 
Fourier  convolution  integral,  differentiates  several  spatial 
orientations  at  various  levels  of  resolution.  For  two  dimensional 
imaging,  Mallat  used  a  well  known  technique  called  "turning  the 
corner".  He  exploited  the  fact  that  the  convolution  kernel  was 
separable  in  the  two  dimensions,  x  and  y.  First,  Mallat  convolved 
the  rows  of  the  image  with  the  one  dimensional  filter,  retained  the 
values  of  the  convolution,  then  perforated  the  same  operation  using 
the  columns  of  the  retained  row  convolution  values.  Mallat 
described  these  filters  (convolution  operations)  as  quadrature 
filters  or  conjugate  mirror  filter  decomposition. 

Using  this  technique,  Mallat  was  able  to  show  orientation 
specific,  texture  discrimination  for  well  defined  digitized  images 
of  boxes  on  top  of  tables,  toy  model  buildings,  and  computer 
generated  preattentive  images  (images  possessing  geotsetric  patterns 
that  can  be  detected  with  little  conscious  human  effort). 
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Mallat's  work  concentrated  on  data  compression  for  image 
processing  which  he  showed  that  with  less  than  1.5  bits  per  pixel, 
the  pristine  images  could  be  reconstructed  with  few  visible 
distortions.  Furthermore,  with  a  priori  knowledge  of  the  signal's 
statistical  intensity  distribution,  Mallat  proposed  that 
optimization  of  the  code  for  signal  processing  could  be  achieved 
(16:674-693). 

Flaton  and  Toborg's  Sparse  Filter  Graphs  for  Image 
Recognition.  Platon  and  Toborg  developed  a  segmentation  and 
recognition  scheme  based  on  two  dimensional  Gabor  functions.  The 
recognition  of  targets  within  non-aimulated  FLIR  images  is  based  on 
the  construction  of  feature  vectors  extracted  from  correlations  of 
the  image  with  the  Gabor  function  at  various  orientations  and 
spatial  frequencies . 

Flaton  and  Toborg  use  of  self  similar  Gabor  functions  was 
primarily  biologically  motivated.  There  is  evidence  which  suggests 
that  Gabor  functions,  or  "Gabor-like"  functions  exist  in  the  visual 
cortex  of  cats  (12:1233-1258).  The  self  similar  Gabor  functions 
they  used  consisted  of  four  frequencies  and  six  evenly  spaced 
orientation  ranging  over  180  degrees  for  a  total  of  24  Gabor 
functions  from  which  the  "jets"  were  generated. 


Each  set  of  coefficients  generated  by  correlating  the  Gabor 
functions  with  the  image  was  "stacked"  in  a  hierarchical  structure 
called  "jets"  (see  Figure  2).  Jets  are  vectors  made  from  the 
coefficients  generated  by  correlating  the  Gabor  function  of  specific 
orientation  and  spatial  frequency  with  the  particular  image  of 
interest.  The  stacks  were  centered  about  a  point  in  the  original 
image.  Therefore,  the  "jets"  represented  the  localized  Gabor 
correl  tion  over  a  neighborhood  which  possessed  an  object  of 
interest . 

If  a  jet  were  generated  for  every  pixel  in  a  128  by  128  image, 
this  set  of  data  would  be  called  a  Gabor  block.  Representing  an 
image  of  this  size,  with  four  frequencies  and  six  orientations, 
would  require  128  pixels  by  128  pixels  by  4  frequencies  by  6 
orientations,  or  nearly  400,000  elements.  Therefore,  Platon  and 
Toborg  devised  a  method  for  determining  which  "jets"  produced  the 
"most  information",  then  stored  only  those  "jets"  possessing  this 
characteristic . 

Platon  and  Toborg  measured  the  likeness  of  one  jet  to  another 
in  terms  of  direction  and  length.  Similarity  (likeness),  combined 
with  two  selection  rules,  was  used  for  determining  the 
characteristic  of  "most  information"  (saliency).  The  proper  choice 
of  the  saliency  measure  determined  the  effectiveness  of  subsequent 
matching  procedures. 
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FOUR  ORIENTATIONS  PER  LAYER. 

EACH  LAYER  POSSESSES  A  FIXED  NUMBER  OF  CYCLES 


Pigure  2.  Jets.  The  hierarchical  "stacking"  of  Oabor 
transform  coefficients.  Each  layer  corresponds  to  a 
spatial  frequency.  Each  layer  possesses  a  given  number 
of  spatial  orientations. 
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The  equation  for  determining  6aliency  as  defined  by  Platon  and 
Toborg  is 

’  1 1 J* I  i  J 

*  min  (||Ja||»||Jb|J)  (7) 

where  J*,  are  two  different  jets. 

The  first  term  is  the  standard  dot  product  of  two  vectors  with 
enhancement  if  the  jets  have  the  same  direction.  The  first 
selection  rule  (the  first  "min"  term  in  equation  7)  compares  the 
reciprocal  ratios  of  the  Gn^altudes  of  the  jets.  If  J1  is  much 
larger  than  J^,  then  the  first  selection  rule  will  diminish  the 
saliency  value. 

The  second  selection  rule  (the  second  "min"  term  in  equation 
7)  will  select  the  minimum  value  between  the  magnitudes  of  the  jet 
vectors.  Hence,  if  the  magnitudes  of  J*  and  are  large,  then  this 
selection  rule  will  emphasize  this  characteristic.  Therefore,  if 
jets  are  roughly  the  same,  then  they  will  exhibit  high  saliency,  and 
be  subject  to  elimination. 

By  generating  and  storing  only  those  jets  possessing  "highest 
information"  content  (Gabor  mini-blocks),  Platon  and  Toborg 


l|Jk|l  ! 


S(J*,Jt)  = 


r  l|J*ll 


(||j*||  ||Jb||> 
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demonstrated  the  potential  for  image  recognition  on  128x128  pixel, 
FLIR  images  of  tanks.  It  should  be  noted  that  their  research  was 
limited  to  100  FLIR  images,  each  image  containing  a  single  target 
(M-60  or  T-62  tank)  which  filled  most  of  the  128x128  pixel  image 
plane. 

The  recognition  scheme  used  as  its  template  one  of  the  stored 
mini-blocks,  to  which  other  mini-blocks  within  the  database  were 
compared.  Eight  of  the  oust  "salient"  jets  within  the  Gabor  mini¬ 
block  of  the  template  were  iteratively  chosen  and  compared  to  all 
jets  within  the  mini-blocks  of  the  test  images.  The  matching  was 
performed  using  the  similarity  (dot  product)  portion  of  the  saliency 
measure.  The  test  image  with  the  highest  set  of  matching  jets  was 
scored  the  correct  response. 

The  Gabor  transforms  used  by  Platon  and  Toborg  were  not 
orthogonal,  that  is  to  say,  the  eigenvectors  corresponding  to  the 
transformation  from  spatial  domain  to  spatial  frequency  doamin  do 
not  constitute  an  orthogonal  set,  hence  some  redundancy  will  be 
found  in  the  transform  output.  Platon  and  Toborg  could  not 
determine  the  effect  of  the  non-orthogonality  of  the  Gabor  transform 
on  the  processing  of  images.  Because  of  the  non-orthogonality  of 
the  Gabor  transform,  no  derivation  of  a  formal  sampling  theorem  was 
possible,  ie.  no  specific  set  of  Gabor  functions  could  reliably 
extract  the  information  necessary  to  classify  the  targets.  Only 
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through  previous  experimental  results  could  Platon  and  Toborg 
determine  which  sets  of  frequencies  and  orientations  of  the  Gabor 
functions  would  work  on  the  PLIR  images.  [  Note  that  Gabor 
transforms  are  not  orthogonal  and  will  lead  to  redundancies  in  the 
output  ]  (5 t 1313-1320) . 

In  suninary,  the  mathematical  background  for  the  use  of  the 
functional  form  of  the  Gabor  transform  is  provided  by  Grossmann  and 
Morlet.  The  works  of  Gabor,  Daugman,  Turner,  and  others  provide  the 
foundation  for  using  Gabor  transforms  for  image  processing.  Platon 
and  Toborg  demonstrate  a  very  limited  application  of  Gabor  transform 
coefficients  to  classify  (recognize)  targets.  The  following  chapter 
will  describe  the  methodology  used  to  develop  the  Gabor  transform 
segmenter  and  provide  the  initial  investigation  into  using  Platon 
and  Toborg' s  method  for  classification. 
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General  Approach  and  Methodoloi 


The  first  preliminary  goal  of  this  research  was  to  develop  and 
implement  a  one  dimensional  Gabor  filtering  algorithm  for  speech 
analysis.  This  effort  used  MathCAD,  a  modeling  simulation  software 
package  which  imports  and  exports  data,  generates  graphs,  tables, 
and  equations  for  implementing  Gabor  transforms  (Appendix  B) . 
Appendix  B  shows  a  MathCAD  template  for  Gabor  transforming  blocks 
of  512  data  points  corresponding  to  speech.  This  portion  of  the 
research  culminated  in  producing  the  correlation  between  the  speech 
signals  and  the  Gabor  function,  the  Gabor  correlogram  and  yielded 
a  better  understanding  of  how  the  Gabor  function  worked. 

The  second  preliminary  goal  of  this  research  was  to  review, 
analyze,  and  assess  a  C-language  code  for  generating  self  similar 
two  dimensional  Gabor  transforms  using  the  UNIX  operating  system. 
Concurrent  to  this  effort  was  the  designing,  development,  and 
implementation  of  a  non-self  similar  Gabor  transform  for  segmenting 
forward  looking  infraRed  (PLIR)  images  using  a  C-language  code.  A 
separate  effort  was  taken  to  develop  code  to  run  on  the  VMS 
operating  system  for  PLIR  image  processing  using  PORTRAN  (See 
Appendix  C,  parts  1  and  2,  BSG.POR  and  BCG. FOR,  respectively). 


s 

I 

The  primary  goal  of  this  thesis  consisted  of  testing  and 
evaluating  the  computer  simulation  of  the  self  similar  and  non-self 
similar  Gabor  transforms  for  their  ability  to  segment  FLIR  images. 

The  code  developed  for  the  VMS  operating  system  was  chosen  for  this 
research  because  of  its  ease  of  operation. 

The  tests  were  designed  to  examine  the  effects  of  varying 
parameters  to  enhance  the  Gabor's  ability  to  segment  raw  FLIR 
images.  These  tests  included  varying  the  frequency  and  orientation 
of  the  Gabor  transforms,  varying  the  spatial  extent  of  the  Gabor 
function,  investigating  the  effects  of  various  in-plane  rotations, 
image  superposition,  comparing  sinusoidal  variation  versus 
cosinusoidal  variation  of  the  Gabor  wavelets,  then  comparing  the 
performance  of  self  versus  non-self  similar  Gabor  transforms  under 
these  conditions.  Once  the  test  results  were  evaluated,  the 
requirements  for  recognition  based  on  parameters  established  during 
testing  were  developed. 

fiafegr-IcgagffiOB.- 

A  block  diagram  of  the  Gabor  based  segmentation-classification 
system  is  shown  in  figure  3.1  and  is  also  included  as  Appendix  K. 
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Figure  3.1  Gabor  segmentation-classification  system. 
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Two  Dimensional  Past  Fourier  Transforms.  The  two  dimensional 
Past  Fourier  Transform  (FFT)  was  the  key  to  developing  the  two 
dimensional  Gabor  transform.  The  FFT  routine  used  for  two 
dimensional  image  processing  was  obtained  from  Gonzalez  and  Wintz 
(7:105-109). 

The  FORTRAN  subroutine  computed  the  FFT  via  a  successive 
doubling  technique  whereby  the  input  array  was  initially  reordered 
(bit  reversed  for  proper  transforming)  followed  by  the  successive 
doubling  calculations  with  the  result  divided  by  the  length  of  the 
input  vector. 

As  noted  by  Gonzalez  and  Wintz,  since  the  FFT  subroutine 
requires  complex  data  format,  any  real  input  data  vector  had  its 
quadrature  term  set  to  zero  prior  to  being  processed  by  the  FORTRAN 
code . 

The  method  of  "turning  the  corner"  was  used  to  accomplish  the 
2-D  FFT.  Turning  the  comer  involved  performing  a  one  dimensional 
FFT  of  the  columns  of  the  data  array  representing  the  image  followed 
by  performing  a  one  dimensional  FFT  of  the  rows  of  the  result  of  the 
first  1-D  FFT.  It  should  be  noted  that  performing  the  FFT  on  the 
rows  first  followed  by  the  FFT  of  the  columns  produces  an  identical 
result . 
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Since  the  2-D  Fast  Fourier  Transform  is  separable  in  its  two 
dimensions,  performing  the  second  FPT  operation  on  the  result  of  the 
first  FFT  is  mathematically  correct. 

Image  input.  The  Forward  Looking  Inf raked  (FLIR)  images  were 
stored  in  240  by  640  pixel  arrays  as  BYTE  or  L0GICAL*1  integers 
whose  pixel  values  were  accordingly  restricted  to  a  range  of  -128 
to  127.  The  BYTE  or  L0GICAL*1  format  allowed  efficient  storage  of 
images.  Bach  image  data  set  was  converted  to  INTEGER  format  before 
manipulation  by  the  Gabor  transform  code. 

Normalization  of  input  image.  Since  energy  normalization  was 
a  serious  concern  for  proper  image  processing,  the  input  image  was 
normalized  by  computing  the  maximum  pixel  value  within  the  given 
input  image,  dividing  every  pixel  value  by  the  maximum,  then 
multiplying  every  pixel  by  255  to  produce  a  scaled  representation 
of  the  input  image. 

PLIR  images  were  also  normalized  using  the  Lambert  technique 
(15:1-86).  Results  and  discussion  about  the  Laafcertization 
technique  are  found  in  Appendix  0. 

Gabor  Function  Generation.  All  Gabor  functions  were  generated 
"On  Center"  in  a  256  by  512  array  using  the  FORTRAN  code  found  in 
Appendix  C.  Since  both  extents  of  the  array  are  even,  a  center 
pixel  does  not  exist.  However,  all  Gabor  functions  were  centered 
t  N/2  about  the  pseudo-center  of  the  array. 
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Three  types  of  Gabor  functions  were  generated  for  image 
processing.  The  first  type  was  the  self  similar  Gabor  function. 
Self  similarity  implies  that  the  deviation  of  the  Gaussian  envelope 
directly  influences  the  sinusoidal  variation  therefore  maintaining 
a  like  number  of  periods  under  the  curve  (similar  frequency 
distribution)  irrespective  of  the  spatial  extent  of  the  Gabor 
function. 

The  spatial  extent,  N,  of  the  Gabor  function  (pixel  by  pixel 
extent)  was  a  parameter  interactively  given  to  the  computer  code 
during  execution  of  the  Gabor  transform  FORTRAN  program.  The 
spatial  extent  determined  the  standard  deviation  of  the  Gaussian 
cofactor  and,  consequently,  the  frequency  of  the  sinusoidally 
varying  cofactor. 

The  second  type  of  Gabor  function  used  was  the  non-self 
similar  Gabor  function.  The  standard  deviation  of  the  Gabor 
function's  Gaussian  cofactor  is  not  related  to  the  frequency  of  the 
sinusoidal  cofactor  therefore,  with  a  constant  Gaussian  envelope 
maintained,  a  varying  number  of  periods  under  the  curve  (frequency 
distribution  of  the  Gabor  function)  can  be  achieved.  A  criterion 
of  four  standard  deviation  units  at  the  ±  N/2  points  was  used  to 
ensure  zero  (or  near  zero)  pixel  values  at  the  maximum  spatial 
extent  or  the  Gabor  functions. 
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The  third  type  of  Gabor  function  generated  was  the  modified, 
or  multi-purpose  Gabor  function.  With  the  multi-purpose  Gabor 
function,  the  standard  deviation  of  the  Gaussian  cofactor  is  a 
scaled  equivalent  to  the  sinusoidal  cofactor's  frequency,  thereby 
combining  the  dilating  characteristic  of  self  similar  Gabor 
functions  with  the  multiple  frequency  characteristic  of  non-self 
similar  Gabor  functions. 

Sine  wave  Gabor  transforms  were  generated  using  a  batch  mode 
submitted  FORTRAN  program  called  BSG.FOR  (Appendix  C,  part  1). 
Cosine  wave  Gabor  transforms  were  generated  using  a  batch  mode 
submitted  PORTRAN  program  called  BCG. FOR  (Appendix  C,  part  2). 

Image  Output  and  Storage.  The  output  of  the  Gabor  transform 
PORTRAN  code  was  the  intensity  or  the  Gabor  filtered  image,  where 
each  pixel  value  corresponded  to  a  percentage  of  the  maximum 
intensity.  All  output  images  were  converted  to  BYTE  format  for  two- 
dimensional  array  storage  by  employing  the  MOD  conversion  to  values 
between  -128  and  127. 


Multiple  Image  Superposition. 


PORTRAN  code  was  developed  to  add  together  (superimpose)  Gabor 
filtered  images  (Appendix  D,  THRBSH_ADD_HIST . POR) .  Histograms  of 
the  intensity  distribution  within  the  superimposed  images  deterr  ined 


a  threshold  level  for  the  filtered  images.  THRESH_ADD_HIST  code 
added,  pixel  for  pixel,  multiple  images,  the  exact  number  and  names 
of  images  determined  by  the  user.  The  superimposed  images  were 
histogranmed  to  find  a  thresholding  level  suitable  for  binarization. 
Table  1.  Bin  number  relative  to  pixel  intensity  value. 
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The  histograning  algorithm  separated  each  pixel  value  into 
bins  according  to  its  value.  Bin  one  corresponded  to  all  pixel 
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values  of  zero.  Bin  two  corresponded  to  values  ranging  from  one  to 
four.  Bin  three  corresponded  to  pixel  values  ranging  from  5  to  9, 
bin  four  corresponded  to  pixel  values  ranging  from  10  to  14,  and  so 
on  until  bin  53  which  corresponded  to  the  value  255.  Table  1  shows 
the  relationship  of  bin  number  to  pixel  range. 


45000 

40000 

35000 

30000 

*— 

z 

ZD 

25000 

o 

o 

z 

CD 

20000 

15000 

10000 

5000 

0 

1 

Figure  3.2.  Histogram  of  tha  intensity  distribution 
for  FLIR  image  REFK41.FLR.  Distribution  of  intensity 
is  nearly  Oaussian. 


Figure  3.2  is  an  example  of  the  histogram  of  the  intensity 
distribution  for  FLIR  images  (in  particular,  REFK41.PLR).  Figure 
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3.3  is  an  example  of  the  intensity  distribution  for  a  Gabor  filtered 
PLIR  image  (in  particular,  FLIR  image:  REPK41.FLR.  Gabor  filter: 
frequency  3,  orientations  0,  45,  90,  and  135  degrees). 

The  bin  containing  the  most  number  of  pixels  determined  the 
initial  lower  bound  on  the  threshold.  Por  the  distribution  found 
in  figure  3.3,  the  initial  lower  bound  was  bin  number  7  (pixel 
intensity  values  ranging  from  24  to  29) . 

Recall,  each  bin  corresponds  to  a  certain  intensity  level. 
Hence,  the  bin  with  the  most  pixels  corresponded  to  the  lower  bound 
on  the  intensity  threshold.  Each  bin  above  the  maximum  cotint  bin 
was  compared  to  a  count  level  set  by  the  user. 

Por  instance,  if  the  user  desired  all  bins  having  number  of 
pixel  counts  greater  than  1000  to  be  discarded,  then  the  user  would 
input  1000  as  a  count  level.  Using  the  bin  count  as  a  threshold  for 
iamge  segmentation  assumes  that,  if  the  segmentation  algorithm  is 
correctly  working,  the  number  of  pixels  associated  with  the  target 
should  be  significantly  less  than  those  associated  with  the 
background. 

Once  the  bin  count  dropped  below  the  count  level  set  by  the 
user,  the  upper  bound  on  the  threshold  was  set  at  this  bin  location. 
For  the  example  in  figure  3.3,  the  upper  bound  was  bin  number  10 
(pixel  values  ranging  from  40  to  44).  The  algorithm  then  searched 
all  bins  prior  to  the  bin  with  the  a»st  number  of  pixels.  The  first 


33 


Figure  3.3.  Histogram  of  intensity  distribution  for 
Gabor  filtered  image  (FLIR  image:  REFK41.PLR,  Gabor: 
freq:  3,  orient:  0,  45,  90,  and  135  degrees). 

Distribution  is  centered  about  the  global  average 
intensity,  facilitating  the  segmentation  process. 

bin  with  more  then  1000  pixels  wee  determined  to  be  the  lower  limit 
to  the  threshold.  If  no  bin  met  this  criterion,  then  the  bin  with 
the  most  number  of  pixels  was  determined  to  be  the  lower  bound  to 
the  threshold.  For  the  example  in  Figure  3.3,  the  initial  lower 
bound  was  the  final  lower  bound.  Note  the  scale  difference  between 
Figure  3.2  and  Figure  3.3.  In  Figure  3.3,  most  of  the  pixels  reside 
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in  one  bin  allowing  easy  thresholding.  The  distribution  of  pixels 
over  the  intensity  spectrum  is  more  Gaussian  in  Pigure  3.2,  thus 
giving  rise  to  the  difficulty  in  choosing  a  proper  ♦‘hrcshold  level. 

Once  the  lower  and  upper  threshold  levels  were  found,  the 
resulting  superimposed  images  were  thresholded  using  a  pass/no-pass 
filter.  All  pixels  in  bins  above  the  upper  threshold  and  all  pixels 
below  the  lower  threshold  were  set  to  unity.  Pixels  in  the  other 
bins  were  set  to  zero. 

THRESH_ADD_HI ST  code  generated  MATRIX-X  readable  files  for 
plots  of  the  histograam  on  screen  using  a  FORTRAN  subroutine 
provided  by  Integrated  System,  Inc.,  makers  of  MATRIX-X.  MATRIX- 
X  is  an  application  software  package  specifically  tailored  for 
linear  algebra. 

utusauk  9 1  inurwt- 

The  binarized  output  of  the  THRESH_AOD_HIST  program  was  fed 
into  a  FORTRAN  program  to  find  the  center  pixel  of  regions  of 
interest  (APPENDIX  B,  SHOW_LAB_PLIR_IM .  FOR) .  SHOW_LAB_PLIR_IM  found 
the  maximum  extent  of  any  region  of  interest  in  both  directions, 
then  computed  the  center  pixel  of  each  of  these  regions. 

After  finding  the  regions  of  interest,  SHOtf_LAB_FLIR_IM 
designated  all  blobs  within  the  regions  as  a  certain  number.  For 
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instance,  the  blob  corresponding  to  region  one  was  labeled  as  one, 
the  blob  in  region  two  as  two,  and  so  on. 

The  output  of  this  program  was  a  listing  of  regions  of 
interest  with  locations  of  the  center  pixels  of  each  of  these 
regions.  In  addition  to  the  listing,  a  display  of  the  regions  of 
interest  was  also  provided  by  this  prograa. 

Computing  .jets  centered  on  region,  of  interest. 

The  locations  of  regions  of  interest  were  fed  into  a  FORTRAN 
prograa  that  computed  the  "jets”  centered  on  these  locations 
(Appendix  G,  JETS. FOR).  Recall  a  jet  is  a  set  of  self  similar  Gabor 
functions  of  varying  sizes  (spatial  extent,  hence  spatial 
frequencies)  and  orientations  within  the  varying  sizes  superimposed 
over  a  center  point  (regions  of  interest  provided  by  the 
SHOWJLABJPLIR_IM  prograa). 

For  this  research,  four  sizes  ranging  from  128x128  to  16x16 
in  octaves  and  four  orientationa  ranging  froa  0  to  13S  degrees  in 
45  degree  increswnts  were  used  such  that,  for  any  given  jet,  there 
were  16  layers  per  jet. 

Since  the  Gabor  transform  code  (Appendix  C)  already  generated 
the  self  siailar  Gabor  filtered  iaages,  the  construction  of  the  jets 
wes  reduced  to  merely  windowing  about  the  center  points  found  by  the 
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SHOW_LAB_PLIR_IM  program  and  superimposing  the  windowed  portions  of 
the  self  similar  Gabor  filtered  images. 

Recognition  of  targets  based  on  iets . 

Twenty  Dimensional  Jet  Vector  Approach.  Each  jet  consisted 
of  twenty  components  corresponding  to  the  center  pixel  values  of 
correlation  between  the  various  frequency  and  orientations  of  the 
self  similar  Gabor  filters  and  the  raw  FLIR  image,  center  pixels 
generated  by  the  SHOW  LAB_FLIR_IM  program.  The  jet  vectors  were 
normalized  by  computing  the  difference  between  a  given  value  and  the 
minimum  value  then  dividing  by  the  maximum  extent  of  the  component 
values 


Original  Component  Value  -  Minimum  Value 

New  Component  Value  - - (8) 

Maximum  Value  -  Minimum  Value 

thus  setting  the  maximum  valued  component  to  unity  and  the  minimum 
valued  component  to  zero.  The  FORTRAN  program  to  generate  the 
vectors  is  found  in  Appendix  H  (VECT_JBTS . FOR) . 

Twenty-dimensional  vectors  used  for  exemplar  set  one  were 
taken  from  the  jets  of  image  REPM13.FLR  for  each  target  type  (tank, 
truck,  APC,  and  POL)  present  within  the  image.  RBFM13.FLR  did  not 


37 


possess  POL  vehicles.  The  jets  obtained  from  REFM13.PLR  were 
"concatenated”  into  a  matrix  format  readable  by  MATRIX-X  and 
compared  to  "concatenated"  jets  of  images  possessing  targets  of 
similar  size  but  differing  in  aspect  angle  and  position  within  the 
image . 

A  simple  Minkowski  two  space,  or  Euclidean,  distance  rule  was 
used  as  baseline  a  comparison  measure  between  vectors  (see  Appendix 
I).  Euclidean  distance  is  the  square  root  of  the  sum  of  the  square 
of  the  difference  between  vectors 

n 

Eud.  Hist.  =  (2  (exemplary  -  test^)$  (9) 
i=l 

where  exemplary  is  the  ith  component  of  the  exemplar  vector  and 
test^  is  the  ith  component  of  the  test  vector.  The  difference 
producing  a  minimum  distance  was  deemed  the  correct  response. 

This  approach  used  vectors  from  RBPM13.PLR  for  the  exemplar 
set  and  compared  this  set  to  vector  sets  from  REPM14.PLR, 
REPM15.PLR,  REPM16.PLR,  REPM17 . FLR ,  REPM18.PLR,  from  RBPM19.PLR. 

A  figure  of  merit  (P.O.M.)  was  assigned  to  the  distances 
between  the  exemplar  vector(s)  and  the  test  vector(s).  The  figure 
of  merit  was  calculated  using  the  following  rule: 
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P.  0.  M. 


Minimum  distance  (x) 
Minimum  distance  (1) 


(10) 


where  x  ranges  from  2  to  6.  The  larger  the  figure  of  merit  value, 
the  more  likely  the  minimum  distance  (1)  is  the  correct  choice. 

Bight  Dimensional  Jet  Vector  Approach.  This  approach  used 
vectors  from  REFM14.FLR  for  the  exemplar  set  and  compared  this  set 
to  vector  sets  from  those  used  in  the  twenty  dimensional  jet  vec ;or 
approach.  This  approach  put  limitations  on  the  twenty  dimensional 
jet  vector  approach.  Pirst,  regional  locations  found  using  the 
Roggemann  centroid  routine  were  used  tc  determine  specific  locations 
from  which  the  vector  (eight  dimensional)  comparison  sets  were 
constructed.  The  specific  locations  used  were  1)  Mid  hull,  side 
viewed  tank,  foreground,  2)  Rear  cog,  side  viewed  tank,  foreground, 
3)  Frcnt  cog,  side  viewed  tank,  foreground,  4)  Left  tread,  front 
viewed  tank,  foreground,  and  5)  Right  tread,  front  viewed  tank, 
foreground . 

Second,  the  Roggemann  centroid  finding  algorithm 
(SHOW_?LIR_IM)  found  the  centroid  of  regions  corresponding  to 
possible  target  locations.  The  actual  locations  used  for  this 
approach  were  manually  positioned  to  eliminate  the  "50X  on  -  50% 
off"  problem  encountered  when  using  the  twenty  dimensional  jet 
vector  approach  since  the  target  encompassed  most  of  the  largest 
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window  size  (16  by  16)  at  these  locations.  Care  was  taken  to  ensure 
that  the  specific  locations  stayed  relatively  close  to  the  original 
positions  determined  by  the  Roggemann  centroid  finding  algoritnm. 

Kth-Nearest  Neighbor  Approach.  The  kth-nearest  neighbor 
approach  involved  the  use  of  a  C-language  based  code  which 
determined  the  distances  between  vectors  for  first,  third,  fifth, 
seventh,  and  ninth  nearest  neighbors.  The  code  randomly  picked  a 
vector  and  computed  the  distance  to  the  first  nearest  neighbor, 
third  nearest  neighbor,  and  so  on  to  the  ninth  nearest  neighbor. 

The  program  then  calculated  a  figure  of  merit  based  on  the 
ratio  of  distance  calculated  to  minimum  distance.  The  nearest 
neighbors  were  identified  as  to  their  respective  vector  designation 
and  class  (ie.  vector  80,  class  0,  compared  to  the  test  vector 
designation  of  0,  class  0).  The  classification  and  accuracy  of 
u^twork  choice  were  then  displayed  as  a  numeric  designation  and 
"right"  or  wrong"  choice,  respectively. 
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IV.  Results  and  Discussion 


The  following  chapter  presents  the  results,  with  their 
respective  discussions,  from  using  the  methods  described  in  chapter 
III.  The  presentation  is  in  three  parts.  The  first  part  discussps 
the  res  Its  of  the  segmentation  portion  of  this  research.  The 
second  part  discusses  the  results  of  the  preliminary  investigation 
into  classification  based  on  Gabor  jet  coefficients.  The  third  part 
proposes  a  possible  optical  architecture  for  accomplishing  Gabor 
transforms . 


Part  1.  SEGMENTATION . 

General  Discussion.  A  general  discussion  of  the  results  is 
presented  to  aid  the  reader  in  understanding  overall  effects  of 
Gabor  transforms  on  PLIR  imagery. 

Non-Self  Similar  versus  Self  Similar.  Figure  4.1  shows  the 
original  FLIR  image  RBFM13.PLR.  From  left  to  right,  in  the 
foreground,  the  targets  in  this  image  are  front  viewed  tank,  side 
viewed  tank,  and  truck.  In  the  background,  the  targets  are,  from 
left  to  right,  armored  personnel  carrier  and  truck. 


Figuze  4.1.  Original  FLIR  image,  REFM13.FLR.  Targets 
are  ...  background:  APC  and  truck,  foreground:  front 
viewed  tank,  side  viewed  tank,  and  truck. 

Figures  4.2  and  4.3  show  the  effects  of  filtering  a  raw  FLIR 
image  through  self  similar  and  non-self  similar  Gabor  filters, 
respectively.  Figure  4.2  is  the  superposition  of  the  correlation 
between  the  raw  FLIR  image  (REFM13.PLR)  and  self  similar  Gabor 
functions  at  frequency  3  and  orientations  of  0,  45,  90,  and  135 
degrees  for  a  Gabor  size  of  16  by  16. 

Figure  4.3  is  the  superposition  of  the  correlation  between  the 
raw  FLIR  image  (REPM13.PLR)  and  non-self  similar  Gabor  functions  at 
frequency  3  and  orientations  of  0,  45,  90,  and  135  degrees  for  a 


Gabor  size  of  16  by  16. 


Figure  4.2.  Correlations  with  self  similar  Gabor 
functions.  Apparently,  self  similar  Gabor  functions 
cannot  segment  images.  A  caveat  to  this  statement  is 
found  in  Appendix  K. 

Apparently,  an  is  seen  in  Figure  4.2,  self  similar  Gabor 
functions  do  not  possess  the  ability  to  segment  the  FLIR  images  used 
for  this  research  effort  (a  caveat  to  this  statement  is  found  in 
Appendix  M) .  This  result  is  not  unexpected  since  the  spread  of  the 
Gaussian  cofactor  must  be  such  as  to  produce  a  sinusoidal  variation 
that  "matches"  the  frequency  content  of  the  image  while  producing 
a  "roll  off'  at  the  maximum  extents  to  maintain  proper  localization 
of  energy. 

On  the  other  hand,  non-self  similar  Gabor  functions  segment 
the  FLIR  images  quite  well,  as  is  seen  in  Figure  4.3.  Processing 


43 


PLIR  image  REFM13.FLR  at  frequency  3/16  cycles  per  pixel  and 
orientations  of  0,  45,  90,  and  135  degrees,  REFM13.FLR  image  is 


Figure  4.3  Correlations  with  non-self  similar  Gabor 
functions.  Indications  around  the  target  are 
relatively  high  compared  to  those  in  Figure  4.2.  This 
is  due,  in  part,  to  ease  of  localization  of  energy. 

reduced  to  only  those  regions  possessing  targets  of  interest.  This 
result  is  to  be  expected  since  four  standard  deviations  correspond 
to  the  maximum  extent  of  the  Gabor  "patch"  when  using  the  non-self 
similar  Gabor  transform  algorithm.  Localization  of  the  energy  to 
within  a  small  region  is  accomplished  by  lisdting  the  spread  of  the 
Gaussian  cofactor.  Therefore,  any  contribution  to  the  correlation 
from  outside  the  Gabor  "patch"  is  negligible. 
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Cosine  wave  variation  versus  Sine  wave  variation.  For 
purposes  of  illustration,  non-self  similar  Gabor  functions  were 
chosen  for  this  section.  Figure  4.4a  shows  the  original  FLIR  image 
RBPJ15.PLR.  The  targets  in  this  FLIR  image  are,  from  left  to  right, 
a  tank,  an  armored  personnel  carrier,  a  target  board,  and  a  truck. 
Figure  4.4b  represents  the  binarized,  non-self  siailar  cosine  wave 
Gabor  filtering  of  raw  FLIR  image  REFJ15.FLR  at  three  cycles  per 
envelope,  orientations  of  0,  45,  90,  and  135  degrees  superimposed. 
As  evident  in  Figure  4.4b,  the  cosine  wave  Gabor  function  acts  as 
a  "body  filler",  paying  more  attention  to  the  slower  changing 
regions  of  the  iaage  than  the  edges. 

Note,  though,  if  the  frequency  of  the  cosine  is  high  relative 
to  the  standard  deviation  (or  spread)  of  the  Gaussian  envelope,  then 
the  cosine  wave  Gabor  function  acts  very  similar  to  the  sine  wave 
Gabor  function  yet  retains  its  body  filling  capacity.  However,  when 
the  frequency  of  the  cosine  approaches  the  "spread"  of  the  Gaussian 
envelope,  relative  insensitivity  to  intensity  is  no  longer  a  feature 
of  the  cosine  wave  Gabor  function. 

At  first  glance,  this  gain  of  dependence  on  the  intensity 
present  within  a  given  image  may  seem  detrimental.  However,  the 
other  key  feature  to  Gabor  transforms,  namely  the  frequency  and 
orientation  dependence,  becomes  extremely  important. 


Figure  4.4.  (a)  Original  FLIR  image,  REFJ15.FLR. 
Targets  are,  from  left  to  right:  tank,  APC,  target 
board,  and  truck  (b)  Binarited  version  of  non-self 
similar  cosine  Gabor  transform  of  FLIR  image 
REFJ15.FLR. 


Figure  4.5a  is  the  superposition  of  raw  FLIR  image  REFM13.FLR 
and  a  test  image  comprised  of  non-self  similar,  3/16  cycles  per 
pixel  cosine  Gabor  functions  (orientations  0,  45,  90,  and  135 
degrees)  and  two  L locks  of  high  intensity  pixel  roughly  located  1/4 
the  distance  from  the  top  of  the  image  and  1/4  from  the  bottom  of 
the  image. 


Figure  4.5*.  REFM13.PLR  with  artificially  added  high 
intensity  blocks  and  0,  45,  90,  and  135  degree,  3  cycle 
cosine  Oabor  functions. 

By  choosing  the  proper  cosine  frequency  and  orientations 
(frequency  3/16  per  pixel  and  orientations  45  and  135),  the  other 
structures  are  passed  the  high  intensity  blocks,  the  tank,  truck, 
and  other  targets  within  the  image  preserved  (see  Figure  4.5b). 


Pigure  4.5b.  Cosine  Gabor  transform  of  modified  FLIR 
image  REFM13.PLR.  Mote  that  targets  are  still 

indicated  even  with  the  high  intensity  corruption 
introduced  by  the  blocks. 

This  intensity  dependence  is  not  as  detrimental  if  the  image 
possesses  little  to  no  correlation  with  the  frequency  and  the 
orientation  of  the  distribution  represented  by  the  cosine  wave  Gabor 
function.  There  is  significant  correlation  with  the  45  degree 
orientation  Gabor  and  the  135  degree  orientation  Gabor  functions 
which  were  added  to  R&PM13.PLR.  This  result  is  expected  since  the 
3/16  cycles  per  pixel  and  the  orientations  exactly  match. 

The  effects  of  using  sine  wave  Gabor  functions  for  image 
segmentation  is  shown  in  Pigure  4.6. 


Figure  4.6  Binarized  version  of  sine  wave  Gabor 
transform  of  FLIR  image  REPJ15.FLR.  Sine  wave  Gabor 
functions  act  as  edge  detectors. 

The  sine  wave  Gabor  function  primarily  detects  edges  provided 
the  particular  sine  wave  frequency  distribution  has  sufficient 
correlation  with  the  frequency  distribution  present  within  the  raw 
PLIR  image. 

The  sine  wave  Gabor  function  acts  as  an  edge  finder, 
disregarding  those  regions  with  little  changes  relative  to  the 
frequency  and  orientation  of  the  sine  wave  Gabor  function,  finding 
only  those  regions  within  a  given  image  that  correspond  to  a 
particular  frequency  and  in-plane  rotation  (orientation). 

The  sine  wave  Gabor  function  (and  the  cosine  wave  Gabor 
function  also  for  that  matter)  will  reject  regions  within  a  given 


inage  possessing  noise  provided  the  noise  does  not  possess 
sufficient  correlation  with  the  spatial  frequency  and  orientation 
of  the  Gabor  functions. 

Therefore,  if  differences  exist  within  a  given  image,  and 
those  differences  correlate  with  a  particular  frequency  and  spatial 
orientation  of  the  sine  wave  Gabor  function,  then  an  indication  will 
result  in  that  region  within  the  image. 

It  should  be  noted  that  the  sine  Gabor  and  the  cosine  Gabor 
are  subject  to  the  overall  average  intensity  found  in  the  PLIR 
image.  If  the  intensity  of  a  target  is  relatively  close  to  the 
average  intensity  within  the  image,  then  the  Gabor  functions  may  be 
hard  pressed  to  segment  those  targets.  In  other  words,  if  the 
intensity  differences  within  a  region  are  not  sufficiently 
different,  then  either  the  sine  nor  the  cosine  Gabor  function  will 
discriminate.  The  targets  in  the  113  FLIR  images  used  for  this 
research  possessed  enough  intensity  to  prevent  this  problem.  It  may 
be  necessary  to  Laafcertize  an  image  prior  to  Gabor  transformation 
if  the  targets  have  intensities  at  or  near  the  overall  image  average 
intensity. 
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Specific  discussion.  A  specific  discussion  is  provided  to 
give  the  reader  in-depth  information  on  the  effects  of  Gabor 
transformation  on  PLIR  imagery. 


Preguencr  variation. 

Non-Self  Similar  versus  Self  Similar.  Por  purposes  of 
illustration,  sine  wave  frequency  variation  will  be  discussed. 
Pigures  4.7a,  b,  and  c  show  the  effects  of  increasing  the  sine 
variation  on  the  superposition  of  correlations  between  raw  PLIR 
image  REFJ15.PLR  and  non-self  similar  Gabor  functions  of  orientation 
0,  45,  90,  and  135  degrees,  size  16xl(.  Figure  4.7a  is  1/16  cycles 
per  pixel,  figure  4.7b  is  3/16  cycles  per  pixel,  and  figure  4.7c  is 
5/16  cycles  per  ptsel . 

As  the  sine  wave  frequency  increases ,  higher  and  higher 
frequency  content  within  the  image  is  exposed.  Edges  become  more 
and  more  enhanced.  However,  as  the  frequency  increases  beyond  5/16 
cycles  per  pixel,  the  higher  frequency  noise  in  resulting  Gabor 
filtered  image  begins  to  corrupt  the  segmentation. 

Apparently,  the  raw  PLIR  image  data  used  for  this  research 
have  an  optisaa  frequency  range  between  3/16  cycles  per  pixel  and 
5/16  cycles  per  pixel.  Optimum  is  defined  as  the  best  segmenting 
of  objects  from  background  as  discerned  by  the  fr.mmn  visual  system. 
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Pigure  4.7a/b/c.  Bf facts  of  changing  tha  fraguancy  of 
tha  non-self  similar  sine  Oabor  sinusoidal  cofactor. 
As  the  frequency  increases,  the  correlations  become 
more  intense  until  an  "optimum**  frequency  is  reached. 
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Furthermore ,  the  frequency  distributions  within  the  image  at 
3/16  cycles  per  pixel  tend  to  be  oriented  at  45  and  135  degrees  from 
vertical,  whereas,  at  4/16  cycles  per  pixel  and  5/16  cycles  per 
pixel,  the  orientation  of  the  frequency  distribution  tends  to  be 
vertical  and  horizontal .  This  phenomenon  shows  the  keen  sensitivity 
of  the  Gabor  functions  to  slight  changes  in  frequency  distributions 
or  textures.  Hence,  the  Gabor  functions  are  very  useful  as  texture 
discriminators  and  can  segment  FLIR  images  based  on  this 
characteristic . 

Figures  4.8a,  b,  and  c  show  the  effects  of  increasing 
frequency  on  the  superposition  of  correlations  between  raw  FLIR 
image  R5FJ15.FLR  and  self  similar  Gabor  functions  of  orientation  0, 
45,  90,  and  135  degrees ,  Gabor  size  16x16.  By  maintaining  a  16  by 
16  Gabor  patch  size,  the  dilations  of  the  self  similar  Gabor 
function  simply  change  the  correspondence  between  the  maximum  extent 
of  the  Gabor  function  and  the  standard  deviation  at  that  extent. 
One  cycle  within  the  16  pixel  extent  corresponds  to  one  standard 
deviation  at  the  maximum  extent  of  the  16x16  Gabor  patch.  Two 
cycles  per  16  pixels  corresponds  to  two  standard  deviations  at  the 
maximum  extent  and  so  forth  up  to  5  cycles  per  16  pixels. 

Figure  4.8a  corresponds  to  one  standard  deviation  at  the 
maximum  extent  of  the  Gabor  function  (16x16),  figure  4.8b 
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corresponds  to  3  standard  deviations,  and  figure  4.8c  corresponds 
to  5  standard  deviations. 

As  the  frequency  of  the  sine  wave  variation  increases,  the 
higher  and  higher  frequency  content  becomes  more  and  more  apparent . 
However,  the  self  similar  Gabor  functions  tend  to  "double  image"  the 
edges  of  the  objects  at  3/16  cycles  per  pixel  (figure  4.8a). 

Since  the  standard  deviation  of  the  Gaussian  envelope  is 
allowed  to  vary,  more  energy  is  included  in  the  correlation  between 
the  image  and  the  particular  Gabor  functions  than  is  found  in  th' 
non-self  similar  Gabor  functions.  Therefore,  one  would  expect  a 
more  significant  ringing  effect  at  this  frequency.  A a  the  frequency 
increases,  and  consequently,  the  spread  of  the  Gaussian  cofactor 
decreases,  more  localization  of  energy  will  occur.  This  effect  is 
desirable  for  segmentation  since  the  premise  for  segmentation  is  the 
localization  of  energy  into  regions  of  interest.  However,  when 
using  the  conventional  self  similar  Gabor  transform,  the  frequency 
of  the  sinusoidal  cofactor  must  match  the  frequency  resident  in  the 
iawge.  Since  the  frequency  of  the  sinusoidal  cofactor  is  equivalent 
to  the  Gaussian  standard  deviation,  localization  of  energy  oust  also 
be  sufficient  to  segment.  Figures  4.8b  and  4.8c  show  significant 
localization  but  little  to  no  frequency  "matching".  Hence,  less  and 
less  of  the  target  regiona  correlate  as  the  frequency  increases 
(standard  deviation  decreases). 
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Pigure  4.8a/b/c.  Effects  of  changing  the  frequency  of 
the  self  similar  sine  Gabor  sinusoidal  cofactor.  As 
the  frequency  increases,  the  spread  decreases,  hence 
more  localisation  of  correlation  energy. 


Cosine  versus  Sine.  For  the  purpose  of  discussion,  non-self 
similar  Gabor  functions  will  be  used  for  the  section.  Pigures  4.9a, 
b,  and  c  show  the  effects  of  increasing  the  cosine  variation  on  the 
superposition  of  correlations  between  raw  PUR  image  REFJ15.FLR  and 
Gabor  functions  at  orientation  0,  45,  90,  and  135.  Figure  4.9a 
corresponds  to  1/16  cycles  per  pixel,  figure  4.9b  corresponds  to 
3/16  cycles  per  pixel,  and  figure  4.9c  corresponds  to  5/16  cycles 
per  pixel. 

As  the  frequency  increases,  the  correlation  energy  is  spread 
into  the  higher  order  lobes  of  the  Gabor  function  tt.ua  giving  the 
cosine  Gabor  function  some  insensitivity  to  gross  intensity,  a 
feature  inherent  to  sine  wave  Gabor  functions. 

In  figure  4.9a,  the  near  replication  of  the  original  image  is 
apparent.  The  region  corresponding  to  the  tank  (far  left  center) 
is  beginning  to  take  shape,  although  the  front  of  the  tank  is 
somewhat  obscured.  The  armored  personnel  carrier  and  truck  are 
readily  discernable.  However,  the  target  board  is  also  obscured. 

Pigure  4.9b  shows  shapes  forming  which  correspond  to  the  tank 
(far  left  center),  armored  personnel  carrier  (center),  target  board 
(right  center),  and  truck  (far  right  center).  Again,  the  image 
lepresented  in  Pigure  4.9c  is  a  near  replication  of  the  original 
image  (Pigure  4.4a). 
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Pigure  4.9a/b/c.  Effects  of  changing  the  frequency  of 
the  non-self  similar  cosine  Oabor  sinusoidal  cofactor. 
As  the  frequency  increases,  target  indications  become 
more  readily  apparent  until  an  "optimum"  frequency  is 
reached . 


Figure  4.9c  shows  the  effect  of  increasing  the  cosine 
frequency  to  5/16  cycles  per  pixel.  The  regions  corresponding  to 
tank,  armored  personnel  carrier,  and  truck  are  readily  6een. 
However,  the  target  board  between  the  armored  personnel  carrier  and 
the  truck  is  obscured.  This  may  be  due,  in  part,  to  the  cosine 
dependency  on  relative  intensity  within  the  target  board  region  as 
well  as  inappropriate  frequency  correlation.  The  background  is 
nearly  eliminated,  leaving  only  the  targets  within  the  image. 

The  lighter  regions  which  borders  the  left  side  of  this  series 
of  iauges  is  due  to  the  512  pixel  limitation  imposed  by  the  PFT 
subroutine  but  does  not  affect  the  performance  of  the  Gabor 
transform  to  segment  image.  The  "tick”  marks  along  the  base  of  the 
images  are  artifacts  generated  by  the  original  iawge  processing. 

This  series  of  images  show  the  increased  necessity  for  having 
proper  frequency  and  orientation  matching.  The  higher  intensity  and 
body  shaping  found  in  Figure  4.9e  is  a  striking  example  of  this 
requirement . 

Gabor  Size. 

The  size  of  the  Gabor  function,  namely  the  spread,  or  standard 
deviation,  works  to  isolate  or  localize  the  correlated  energy  into 
regions  specific  to  edges  (when  using  the  sine  wave  Gabor  function) 
and  bodies  (when  using  the  cosine  Gabor  function). 
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As  the  Gabor  size  becomes  larger,  more  and  more  energy  beyond 
the  edges  is  being  correlated  with  the  Gabor  function,  acting  to 
diffuse  the  edges. 

This  concept  is  similar  to  that  proposed  by  Siebert  and  Waxman 
in  their  paper  about  a  neural  network  design  which,  essentially, 
diffuses  energy  from  regions  surrounding  edges  towards  the  edge  to 
localize  the  detection  of  edges:  segmentation  (22:9-27).  The  Gabor 
function  works  to  localize  the  energy  by  reducing  the  extent  of  the 
spreading  via  the  Gaussian  envelope  and  retains  frequency 
specificity  by  introducing  the  sinusoidal  variation.  Hence,  the 
Gabor  function  produces  a  more  localized  correlation  while 
maintaining  a  specific  "matched"  filter  characteristic. 

Non-Self  Similar  versus  Self  Similar.  The  sequence  of  figures 
4.10a,  b,  and  c  shows  the  effect  of  increasing  the  Gabor  size  yet 
maintaining  the  cycles  per  pixel  ratio  (non-self  similar  Gabor 
"patch"  size). 

Figure  4.10a  is  the  superposition  of  the  correlations  between 
non-self  sisular  Gabor  functions  of  "patch"  size  64x64,  frequency 
32,  orientations  0,  45,  90,  and  135  degrees  with  the  raw  FLIR  image 
RBFM13.FLR  (four  images  superimposed). 

Figure  4.10b  is  the  superposition  of  the  correlations  between 
non-self  similar  Gabor  functions  of  "patch"  size  32x32,  frequency 
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Figure  4.10a/b/c.  Effects  of  changing  the  Gabor  patch 
size  on  non-self  similar  Gabor  transformation  of  FLIR 
image  REFM13.FLR.  As  the  Gabor  patch  size  increases, 
blurring  occurs  due  to  increase  in  correlation  area. 


16,  orientations  0,  45,  90,  and  135  degrees  with  the  raw  FLIR  inage 
RBPM13.PLR. 

Figure  4.10c  is  the  superposition  of  the  correlations  between 
non-self  similar  Gabor  functions  of  "patch"  size  8x8,  frequency  4, 
orientations  0  ,  45  ,  90,  and  135  degrees  with  the  raw  FLIR  inage 
RBFM13.PLR. 

When  the  Gabor  size  changes,  with  the  number  of  cycles 
remaining  the  same,  the  effect  is  that  of  a  self  similar  Gabor 
function.  The  standard  deviation  of  the  Gabor  functions  changes  as 
the  Gabor  size  dilates.  The  frequency  changes  proportionally  to  the 
Gabor  size  as  well.  This  effect  is,  by  definition,  self  similar. 
The  frequency,  therefore,  must  increase  as  the  Gabor  size  increases 
to  maintain  a  constant  cycles  per  pixel  ratio  and  to  retain  the  non¬ 
self  similar  nature  of  the  Gabor  function. 

As  the  Gabor  patch  size  increases,  more  energy  from  the 
background  surrounding  the  target  within  the  image  is  correlated 
with  the  Gabor  function,  henca,  less  localization  of  energy  about 
the  target(a)  within  the  image.  Consequently,  as  the  Gabor  patch 
size  increases,  the  "resolution"  of  the  filtered  image  is  decreased 
and  tha  ability  of  the  Gabor  function  to  segment  the  image  is 
diminished. 

In  figure  4.10a,  the  detected  regions  tend  to  be  "blotchy", 
no  coherent  form  to  tha  regions  of  relatively  high  correlation. 
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This  appears  to  be  a  "de-focused"  view  of  the  regions  surrounding 
the  front  viewed  tank,  foreground,  side  viewed  tank,  foreground,  and 
truck,  foreground.  No  discemable  targets  can  be  seen  in  the 
background . 

Figure  4.10b  shows  more  localized  correlations,  localized  to 
the  regions  of  interest,  namely  targets  in  foreground  and 
background.  However,  no  recognizable  shapes  can  be  seen.  Again, 
this  image  appears  to  be  a  "de-focused"  view  of  the  targets. 

Figure  4.10c  shows  very  localized  correlation  energy. 
Outlines  of  the  treads  of  the  front  viewed  tank,  foreground  are 
readily  apparent.  The  shape  of  the  side  viewed  tank  is  beginning 
to  take  fora.  As  is  seen  in  figure  4.10a  and  10b,  the  lighter 
region  to  the  left  of  the  image  is  due  to  the  512  pixel  limitation 
of  the  PFT  subroutine. 

The  sequence  of  figures  4.11a,  b,  and  c  shows  the  effect  of 
increasing  the  window  size  while  maintaining  one  cycle  per  envelope 
(self  similar  Gabor  "patch"  size). 

Figure  4.11a  is  the  superposition  of  the  correlations  between 
self  similar  Gabor  functions  of  "patch"  size  64x64,  frequency  1, 
orientations  0,  45,  90,  and  135  degrees  with  the  raw  PLIR  image 
REFM13.FLR  (four  images  superimposed). 

Figure  4.11b  is  the  superposition  of  the  correlations  between 
self  similar  Gabor  functions  of  "patch"  size  32x32,  frequency  1, 


62 


Pigure  4.11a/b/c.  Effect  of  changing  Gabor  patch  size 
on  self  similar  Gabor  transformation  of  PLIR  image 
REPM13.PLR.  As  the  Gabor  patch  size  increases,  more 
image  pixels  are  included  in  the  correlation  region, 
hence  blurring  occurs. 
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orientations  0  ,  45  ,  90,  and  135  degrees  with  the  raw  FL1R  image 
REPM13.PLR. 

Figure  4.11c  is  the  superposition  of  the  correlations  between 
self  similar  Gabor  functions  of  "patch"  size  8x8,  frequency  1, 
orientations  0,  45,  90,  and  135  degrees  with  the  raw  FLIR  image 
REPM13.PLR. 

By  keeping  the  frequency  constant  but  varying  the  window  size, 
the  net  effect  is  that  of  self  similarity.  As  the  window  size 
increases,  the  Gabor  function  frequency  decreases.  When  the  window 
size  increases,  the  frequency  of  the  Gabor  function  decreases,  which 
"blurs"  the  image.  Conversely,  making  the  window  size  smaller, 
hence  increasing  the  frequency  of  variation  of  the  Gabor  function, 
will  tend  to  "sharpen"  the  image  relative  lv  a  larger  window  size. 

The  Gabor  window  size  is  important  for  energy  localization. 
If  the  Gabor  window  is  too  large,  then  the  ratio  between  the 
background  energy  and  target  energy  within  the  correlation  region 
is  high  and  the  correlation  is  primarily  with  the  background  and  not 
the  target.  In  other  words,  the  energy  is  no  longer  localized  on 
and  inediately  around  the  target,  rather  spread  or  diffused  into 
the  background  region  surrounding  the  target,  blurring  the  target 
region.  This  effect  is  clearly  evident  in  the  series  of  images 
(4.11a,  b,  and  c  sequence). 


64 


Figure  4.11c  shows  the  effect  of  a  large  window  size  (64  by 
64).  The  regions  surrounding  the  targets  are  indistinguishable. 
No  shapes  can  be  seen.  Although,  in  a  global  sense,  the  energy  is 
beginning  to  be  localized  to  the  target  regions. 

Figure  4.11b  shows  store  localization  due  to  the  decrease  of 
window  size  to  32  by  32.  The  region  corresponding  to  front  viewed 
tank,  foreground  and  side  viewed  tank,  foreground  are  significantly 
localized  suggesting  that  self  siailar  Gabor  functions  can,  in  fact, 
ns?£nt  (see  Appendix  M). 

Figure  4.11c  shows  the  effect  of  decreasing  the  window  size 
to  8  by  8.  Bnergy  is  localized  to  regions  surrounding  the  targets 
in  the  background.  However,  the  corresponding  frequency  is  high 
enough  to  detect  the  clutter  surrounding  the  targets  in  the 
foreground . 

The  results  in  figures  4.11a,  b,  and  c  suggest  that  care  must 
be  taken  to  ensure  the  interplay  between  localization  and  frequency 
switch  is  optimized  to  use  self  siailar  Gabor  functions  for 
segmentation. 

In  summary,  Gabor  transforms  successfully  segsmnt  the  FLIR 
images  used  in  this  research.  Sine  wave  Gabor  functions  act  as  edge 
detectors  whereas  cosine  Gabor  functions  act  as  "body  fillers".  In 
combination,  sine  and  cosine  Gabor  functions  produce  fully  segnmnted 
targets.  Since  the  segmentation  of  FLIR  images  is  successful,  then. 
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from  a  biological  standpoint,  the  Metric  for  segmentation  should 
also  be  the  metric  for  classifying  or  recognizing. 
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Part  2.  CLASSIFICATION 


Part  2  of  chapter  IV  discusses  the  preliminary  investigation 
into  the  use  of  Platon  and  Tobcrg's  jet  vector  approach  for 
classification  (5:1313-1320).  Several  approaches  were  investigated. 
The  first  attempt  to  classify  targets  based  on  Gabcr  coefficients 
used  five  layers  (corresponding  to  frequencies),  each  with  four 
orientations  (0,  45,  90,  and  135)  to  comprise  a  twenty  dimensional 
jet  vector.  The  second  attempt  reduced  the  number  of  layer  to  two, 
retaining  the  four  orientation  (sublayers)  to  produce  eight 
dimensional  jet  vectors.  The  third  attempt  reduced  the  number  of 
possible  jet  vectors  to  five  specifically  located  jets.  The  fourth 
attempt  employed  a  kth  nearest  neighbor  network  to  investigate 
variations  in  number  of  possible  classes  and  number  of  input 
components . 

Twenty  Dimensional  Jet  Vector  Approach. 

Requirements  for  Classification.  Based  on  the  results  of 
using  non-self  similar  Gabor  functions  to  segment  FLIR  images, 
certain  requirements  were  needed  to  investigate  a  Gabor  based 
classification  system. 

These  requirements  were  1)  jet  vectors  with  components  having 
a  "meaningful"  value,  2)  properly  thresholded  images  to  produce 
consistent  jet  locations,  and  3)  sufficient  dynamic  range  for  vector 
components  to  discriminate  between  vectors. 


"Meaningful  vector  component  value".  The  concept  of 
"meaningful"  vector  component  value  is  simply  stated:  If  the  value 
for  the  correlation  coefficient  is  derived  from  primarily  target 
pixels  and  not  the  background,  then  the  component  of  the  jet  vector 
is  "meaningful"  relative  to  gaining  information  about  the  target. 

When  the  background  occupies  more  than  SO  percent  of  the  Gabor 
window  size,  then  the  Gabor  coefficient  value  associated  with  that 
jet  vector  component  does  not  convey  information  about  the  target, 
rather  it  conveys  information  about  the  background. 

For  the  FLIR  images  used  in  this  research,  a  Gabor  window  size 
32  by  32  or  greater  did.  in  seneril,  axcasd  the  50  percent  limit. 
Therefore,  the  twenty  dimensional  jet  vector  approach  for 
classification  did  not  produce  "meaningful”  vector  component  values 
since  twelve  out  of  the  twenty  components  for  each  vector  had  values 
corresponding  to  the  correlation  with  the  background  and  not  with 
the  target. 

Classification  of  targets  into  truck,  tank,  and  APC  for  FLIR 
images  in  Data  Set2  (Exemplar  set  from  REFM13.FLR,  Comparison  sets 
from  RBPM14.FLR  through  REFM19.FLR)  based  on  twenty  dimensional 
vectors  was  not  successful .  Less  than  51  of  the  targets  were 
properly  identified.  This  was  not  unexpected  since  most  of  the 
component  values  of  the  vectors  were  correlation  coefficients 
associated  with  the  background  and  not  with  the  target. 
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Proper  thresholding  for  consistent  jet  locations.  Another 
problem  with  the  twenty  vector  approach  was  the  on  center  nature  of 
the  vectors  used  for  exemplars.  For  instance,  Gabor  filtering  FLIR 
image,  REFM13.FLR  using  frequency  3/16  cycles  per  pixel, 
orientations  45  and  135  degrees  for  sine  wave  Gabors,  orientations 
0  and  90  degrees  for  cosine  wave  Gabors,  only  six  on  center 
locations  were  produced. 

The  locations  were  associated  with  the  left  and  right  treads 
of  the  front-viewed  tank  in  the  foreground,  the  body  of  the  side 
viewed  tank  in  the  foreground,  the  rear  cog  of  the  side  viewed  tank 
in  the  foreground,  the  barrel  flashguard  on  the  side  viewed  tank  in 
the  foreground,  and  the  truck  in  the  background. 

Apparently,  the  thresholding  of  the  image  eliminated  the 
armored  personnel  carrier  in  the  background  as  well  as  the  finer 
detailed  features  of  the  side  viewed  tank  in  the  foreground,  such 
as  the  road  wheels  and  upper  rollers,  features  which  could  be  used 
for  classification. 

With  proper  thresholding,  the  finer  details  of  the  targets 
within  the  iaage(s)  will  be  passed,  thus  providing  multiple  looks 
within  a  given  target  region. 

In  hindsight,  classifying  targets  based  on  a  vector  located 
at  the  center  of  a  target  did  not  make  sense.  This  approach  is 
analogous  to  a  psychophysical  test  of  "flashing"  an  image  in  front 
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of  a  subject  for  less  than  100  milliseconds  and  then  asking  the 
subject  to  describe  the  entire  image.  Since  humans  cannot  begin 
scanning  an  image  in  le*s  than  100  msec,  only  a  single  look  is 
possible  (13:67). 

The  assumption  that  enough  information  may  be  at  the  center 
of  each  object  to  classify  that  object  is  risky.  Consider 
describing  an  elephant  by  looking  at  a  1/8  inch  patch,  on  center 
along  the  side  of  the  elephant. 

Therefore,  multiple  looks  within  a  target  region  combined  with 
limiting  the  Gabor  window  to  16  by  16  and  8  by  8  was  considered  a 
viable  alternative  to  the  single,  on  center  look  with  window  sizes 
ranging  from  128  by  128  to  8  by  8,  reduction  in  size  by  octaves. 

Sufficient  dynamic  range  of  vector  components.  Typical  values 
for  vector  components  using  the  eight  component  vector  approach 
ranged  from  0.5  to  1  which  significantly  reduced  the  dynamic  range 
for  vector  distances.  By  "spreading"  the  vector  component  values 
to  range  from  zero  to  unity  using  equation  8,  the  dynamic  range  for 
distance*  was  increased  to  produce  sufficient  distances  between 
vectors,  thus  enhancing  the  chance  for  classification  based  on  this 
feature . 
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Eight  Dimensional  Jet  Vector  Approach. 

Data  Setl  (Exemplar  vectors  from  REFM 13.PLR).  After  proper 
segmentation  and  thresholding  or  PLIR  image  REFM13.PLR,  twenty- 
three,  eight  dimensional  vector  exemplars  were  generated  instead  of 
six  twenty  dimensional  vector  exemplars.  The  twenty-three  vector 
exemplar  set  was  compared  to  the  test  vectors  from  PLIR  images 
REPM14.PLR  through  REF..i9.FLR. 

The  attempt  to  classify  targets  using  eight  component  vectors 
(Gabor  coefficients  from  16  by  16  and  8  by  8  window  sizes)  was  not 
successful.  Table  2a  shows  typical  results  from  determining  the 
Euclidean  distance  between  exemplar  (REFM13.FLR)  and  test  vectors 
(REFM17.PLR,  specifically). 

REPM17.PLR  possessed  24  locations  from  which  jet  vectors  were 
constructed.  Each  column  corresponds  to  the  vector  location.  For 
instance,  columns  1  through  8  correspond  to  locations  1  through  8 
in  PLIR  image  REPM17.PLR.  The  first  six  numbers  in  each  column 
represent  the  six  shortest  distances  between  the  exemplar  vectors 
generated  from  RBPM13.PLR  and  the  specific  test  vector  generated 
from  REPM17.FLR,  rank  ordered.  The  last  six  values  in  each  column 
correspond  to  the  number  of  the  exemplar  vector  to  which  the  test 
vector  compared,  also  rank  ordered.  For  instance,  0.8495  is  the 
dii  jnce  between  exemplar  vector  3  and  test  vector  1,  0.8539  is  the 
distance  between  exemplar  vector  22  and  test  vector  1,  and  so  forth. 
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Table  2a.  Euclidean  distances  between  exemplar  and 
test  vectors  (Exemplar:  REFM13 . PLR,  Test:  REPM17.PLR) 


Test. 

No. 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

0.850 

0.294 

0.653 

0.431 

0.764 

0.902 

0.616 

0.599 

0.654 

0.150 

0.506 

0.506 

0.854 

0.527 

0.733 

0.526 

0.764 

0.964 

0.632 

0.638 

0.891 

0.635 

0.730 

0.562 

Eucl . 

1.119 

0.585 

0.769 

0.754 

0.786 

1.1(3 

0.752 

0.754 

0.986 

0.708 

0.873 

0.592 

Dist. 

1.136 

0.655 

0.779 

0.835 

0.868 

1.227 

9.796 

0.756 

1.038 

0.865 

0.905 

0.639 

1. 156 

0.712 

0.822 

0.838 

1.015 

1.237 

0.855 

0.771 

1.038 

0.925 

0.914 

0.641 

1.227 

0.815 

0.989 

0.925 

1.038 

1.334 

0.913 

1.026 

1.046 

0.945 

0.971 

0.743 

3 

6 

7 

8 

8 

3 

6 

6 

13 

7 

6 

13 

Tapi 

22 

2 

2 

1U 

22 

4 

7 

2 

14 

16 

2 

14 

No. 

11 

l 

6 

16 

4 

10 

l 

l 

22 

15 

1 

6 

4 

19 

1 

9 

It 

22 

16 

7 

1 

6 

8 

19 

15 

12 

16 

14 

16 

9 

2 

12 

19 

2 

7 

2 

18 

13 

15 

4 

9 

8 

8 

19 

4 

12 

12 

23 

Test. 

No. 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

0.417 

0.382 

0.477 

0.922 

0.679 

9.337 

0.573 

0.718 

0.(34 

1.227 

1.57’ 

0.866 

0.679 

0.508 

0.477 

1.180 

0.794 

0.382 

1.767 

0.867 

0.655 

1.311 

1.596 

1.140 

Enel. 

0.925 

0.618 

0.653 

1.271 

0.886 

0.602 

0.798 

1.007 

0.754 

1.398 

1.772 

1.191 

Dist. 

0.945 

1.038 

0.919 

1.291 

1.123 

0.797 

0.980 

1.017 

0.911 

1.399 

1.790 

1.241 

0.950 

1.083 

1.059 

1.311 

1.230 

0.826 

1.012 

1.102 

0.945 

1.452 

1.794 

1.338 

0.968 

1.217 

1.097 

1.311 

1.254 

0.978 

1.078 

1.121 

1.116 

1.462 

1.810 

1.349 

15 

15 

15 

3 

16 

to 

11 

22 

19 

19 

21 

3 

Tap  1 

11 

7 

7 

4 

15 

8 

3 

3 

1 

1 

1 

21 

No. 

18 

16 

16 

22 

7 

14 

18 

11 

23 

3 

3 

4 

12 

12 

12 

19 

8 

13 

15 

4 

2 

23 

20 

22 

16 

ll 

6 

10 

1 

4 

17 

9 

6 

17 

6 

15 

22 

6 

1 

1 

11 

6 

5 

10 

13 

10 

15 

1 

1 
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Table  2b.  Figure  of  Merit  (F.O.M.)  associated  with 
data  in  Table  2a. 


1 

2 

3 

4 

5 

0 

7 

8 

9 

10 

11 

12 

? 

1.005 

1.789 

1.122 

1.220 

1.000 

1.009 

1.025 

1.005 

1.304 

4.218 

1.442 

1.109 

3 

1.329 

1.987 

1.177 

1.749 

1.029 

1.208 

1.220 

1.259 

1.508 

4.706 

1.724 

1.170 

4 

1.337 

7.720 

1.192 

1.935 

1.135 

1.301 

1.292 

1.263 

1.58? 

5.747 

1.788 

1.202 

5 

1.301 

7.421 

1.258 

1.942 

1.328 

1.373 

1.387 

1.287 

1.588 

0.147 

1.805 

1.260 

6 

1.(45 

2.708 

1.513 

2.144 

1.358 

1.479 

1.481 

1.714 

1.000 

0.280 

1.918 

1.400 

13 

14 

15 

10 

17 

18 

19 

20 

21 

22 

23 

24 

2 

1.078 

1.329 

1.000 

1.280 

1.170 

1.132 

1.3(0 

1.208 

1.511 

1.008 

1.015 

1.315 

3 

7.716 

1.015 

1.370 

1.378 

1.300 

1.784 

1.393 

1.402 

1.739 

1.140 

1.127 

1.375 

4 

7.305 

2.715 

1.928 

1.400 

1.055 

2.303 

1.713 

1.419 

2.100 

1.140 

1.138 

1.432 

5 

7.770 

2.832 

2.202 

1.422 

1.812 

2.449 

1.767 

1.534 

2.179 

1.184 

1.141 

1.544 

6 

7.330 

3.183 

2.300 

1.422 

1.848 

2.900 

1.882 

1.500 

2.573 

1.191 

1.151 

1.557 

Table  2b  shows  the  figure  of  aerit  assigned  to  the  distances 
within  a  given  column  relative  to  the  minima  distance.  Test 
vectors  20  through  23  were  generated  at  locations  corresponding  to 
road  wheels  associated  with  the  side  viewed  tank  in  the  foreground. 
Bach  of  these  vectors  were  correctly  aatched  with  vectors  froa  the 
test  set.  However,  the  figure  of  aerit  associated  with  these 
"correct"  responses  ranged  froa  1.0681  to  1.5105. 

Test  vector  ten,  which  was  generated  at  a  location  associated 
with  the  right  tread  of  the  front  viewed  tank  in  the  foreground  in 
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FLIR  image  REFM17.FLR,  did  not  match  with  the  choices  given.  The 
figure  of  merit  suggests,  however,  that  the  first  choice,  exemplar 
vector  7  (associated  with  the  front  end  of  the  side  viewed  tank  in 
the  foreground),  was  a  very  good  choice,  P.O.M.  equal  to  4.2182. 

These  results  indicate  an  inconsistency  in  generating  a 
feature  for  classifying  targets.  It  should  be  noted  that  these 
results  are  based  on  a  very  limited  data  set.  This  inconsistency 
was  not  unexpected  considering  the  segmentation  centroid  location 
scheme . 

First,  segmentation  of  the  R£PM  series  of  FLIR  images  was 
accomplished  using  sine  wave  Gabor  function.  Since  sine  wave  Gabor 
functions  produce  edge  enhanced  targets  within  the  image,  subsequent 
thresholding  and  blob  centroid  determination  produced  jet  vector 
locations  at  the  periphery  of  the  targets  within  the  image. 

Second,  by  generating  vector  locations  along  the  periphery  of 
the  targets  within  the  FLIR  image,  roughly  half  of  the  Gabor  window 
correlated  with  the  target  and  half  with  the  background.  Therefore, 
successful  target  classification  is  directly  attributable  to  two 
factors:  1)  the  clutter  (noise)  surrounding  the  target(s)  and  2) 
the  amount  of  "meaningful  information”  within  the  target(s)  at  the 
vector  location(s).  Meaningful  information,  in  this  application, 
is  meant  to  imply  that,  at  the  specific  vector  location(s),  there 
is  enough  information  about  the  target  to  classify  it. 
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Only  11.7  percent  of  the  target  components  (treads,  wheel 
cogs,  hull,  turret,  etc.)  were  correctly  classified  using  this 
approach.  Another  method  was  attempted  for  classifying  detailed 
structure(s)  within  the  target  regions.  This  alternative  method 
involved  limiting  the  construction  of  the  eight  dimensional  jets  to 
five,  manually  and  specifically  placed  locations. 

Data  Set 2  (Exemplar  vectors  from  RBPM14.PLR).  Table  3a  shows 
typical  results  for  determining  the  distance  between  the  exemplar 
(REFM14.PLR)  and  test  set  (REPM1 3 . PLR)  jet  vectors  specifically 
located  within  the  foreground  target  regions.  Each  column 
corresponds  to  the  specified  location  in  the  test  vector  set:  1) 
Mid  Hull,  side  viewed  tank,  foreground,  2)  Rear  cog,  side  viewed 
tank,  foreground,  3)  Pront  cog,  side  viewed  tank,  foreground,  4) 
Left  tread,  front  viewed  tank,  foreground,  5)  Right  tread,  front 
viewed  tank,  foreground. 

The  first  five  values  in  each  column  correspond  to  the  actual 
distances,  rank  ordered  from  one  to  five.  The  last  five  values  in 
each  column  correspond  to  the  exemplar  vector  number,  as  specified 
above.  Por  instance,  the  distance  0.7478,  in  column  one, 
corresponds  to  the  distance  between  test  vector  one  and  exemplar 
vector  one,  and  so  on.  Therefore,  for  a  perfect  classification 
score,  row  six  of  the  ten  by  five  matrix  should  read  1,  2,  3,  4,  5. 
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Table 

test 

3a.  Euclidean 

vectors  (Exemplar 

distances  between  exemplar  and 
:  REFM14.FLR,  Test:  REFM13.FLR) 

COLUMN  1 

COLUMN  2 

COLUMN  3 

COLUMN  4 

COLUMN  5 

MID-HULL 

IE A!  COG 

PINT  COG 

LEFT  TI. 

IGHT  TR. 

DIST 

0.7471 

0.9677 

0.1373 

0.9011 

0.7593 

1.7410 

1.4621 

1.2049 

0.9013 

1.0107 

1.2764 

1.4974 

1.2115 

1.0340 

1.0740 

1.5511 

1.5025 

1.5434 

1.4700 

1.2724 

1.5913 

1.5177 

1.6102 

1.6519 

1.4516 

TGT 

1 

2 

2 

4 

3 

MID-HULL 

1EAI  COG 

KEA1  COG 

LEFT  TI. 

PINT  COG 

2 

4 

3 

5 

5 

HA!  COG 

LEFT  TI. 

PINT  COG 

IGHT  TI. 

IGHT  TI. 

5 

5 

1 

3 

4 

IGHT  Tt. 

IGHT  TI. 

MID-HULL 

FINT  COG 

LEFT  TI. 

3 

1 

5 

2 

2 

PINT  COG 

MID-HULL 

IGHT  Tt. 

IEA1  COG 

REAR  COG 

4 

3 

4 

1 

t 

LEFT  Tl. 

PINT  COG 

LEFT  TI. 

MID-HULL 

MID-r’.L 
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The  mid  hull,  side  viewed  tank,  foreground  vector  of  the  test 
set  matched  with  the  mid  hull,  side  viewed  tank,  fc-eground  vector 
of  the  exemplar  set,  as  did  the  rear  cog,  side  viewed  tank, 
foreground  and  the  left  treat,  front  viewed  tank,  foreground 
vectors.  The  front  cog,  side  viewed  tank,  foreground  vector  and  the 
right  tread,  front  viewed  tank,  foreground  vector  were  second 
choices  when  comparing  REPM13.FLR  to  REPM14.FLR.  This  raises  the 
question,  "  How  good  is  first,  second,  third  choices  ?  " . 

Table  3b  shows  the  figure  of  merit  associated  with  second 
through  fifth  choices  for  comparison  between  exemplar  (REFM14.PLR) 
and  test  set  (REFM13.PLR) . 

Figure  of  merit  values  greater  than  1.35  usually  indicate 
strong  confidence  of  choice.  Therefore,  the  first  choices  for 
vectors  one,  two,  and  three  have  strong  confidence.  However,  the 
figure  of  merit  values  for  vectors  four  and  five  are  below  1.35. 
In  particular,  vector  4  has  a  F.O.M.  of  1.0002,  indicating  very  low 
confidence  in  its  first  choice,  suggesting  that  its  second  choice 
is  equally  probable. 

These  typical  results  indicate  promise  in  using  Gabor 
correlation  coefficients  for  classifying  targets  within  FLIR  images 
used  in  this  research.  This  method  is  not  fault-proof  as  is  readily 
apparent  in  the  data  presented  in  tables  3a  and  3b.  The  second 
choice  for  vector  three  is  the  correct  choice  yet  its  F.O.M.  is 
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Table  3b.  Pigur-'  of  Merit  (P.O.M.)  associated  with 
data  in  Table  3a. 


COLUMN  1 
MID-HULL 

COLUMN  2 

1EAK  COG 

COLUMN  3 

PINT  COG 

COLUMN  4 

LEFT  Tl. 

COLUMN  5 
IGHT  Tl. 

2 

1.(594 

1.5109 

1.4390 

1.0002 

1.3312 

3 

1.7068 

1.5474 

1.4469 

1.1474 

1.4145 

4 

2.0844 

1.5526 

1.8432 

1.6314 

1.6759 

5 

2.1279 

1.5624 

1.9231 

1.8332 

1.9118 

1.439,  well  above  the  1.35  threshold  for  high  confidence.  The 
second  choice  for  vector  five  has  a  P.O.M  of  1.3312,  slightly  under 
the  1.35  high  confidence  threshold,  yet  this  choice  is  incorrect. 

Table  3c  shows  the  overall  effects  of  limiting  the 
:onstruction  of  jets  to  the  five  specific  locations.  The  first 
column  (heading  TEST)  indicates  the  image  from  which  the  test 
vectors  were  derived.  "Target  number"  indicates  the  view  of  the 
targets  in  the  foreground  (1  corresponds  to  side  viewed  tank,  2 
corresponds  to  front  viewed  tank) . 
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Table  3c.  Performance  of  jet  vector  recognition  using 
five  specifically  located  jets. 


Test 

Tet  1 

On  Turret  De t a i led  Substructure 

Test  Tet  4  On  Turret 

Detii led  Substructure 

113 

l 

100/62/33  60/40/0 

£30  1 

100/33/100 

40/40/20 

s 

so/too/so 

2 

100/50/50 

MIS 

l 

67/33/33  40/20/0 

£31  l 

67/0/33 

40/0/20 

2 

100/100/0 

2 

50/50/0 

MU 

1 

33/33/33  20/40/20 

£32  1 

100/0/67 

60/20/0 

2 

100/100/0 

2 

100/50/0 

MU 

1 

100/62/67  60/0/20 

£33  1 

33/0/100 

20/20/20 

2 

50/100/50 

2 

50/50/0 

MU 

1 

67/67/67  20/40/20 

£34  l 

33/0/67 

0/40/0 

2 

50/100/50 

2 

50/100/0 

MU 

i 

67/33/67  20/20/20 

£35  1 

33/67/100 

0/40/20 

2 

100/50/50 

2 

50/50/0 

KU 

1 

67/33/67  20/20/0 

£36  1 

33/13/100 

0/40/20 

2 

50/100/0 

2 

0/100/50 

no 

1 

33/33/100  20/40/0 

£41  1 

67/0/67 

20/40/0 

2 

50/100/50 

2 

100/100/0 

m 

1 

33/67/33  0/60/0 

£42  l 

33/67/67 

20/40/40 

s 

50/100/0 

2 

50/50/50 

m 

1 

33/100/33  20/60/0 

£43  1 

31/0/100 

0/20/0 

2 

100/50/50 

2 

100/50/0 

£23 

1 

0/0/100  0/0/20 

£44  1 

100/0/67 

20/20/20 

2 

0/50/0 

2 

50/50/0 

£24 

l 

67/67/67  20/40/0 

£45  l 

67/0/67 

20/20/20 

2 

0/50/0 

2 

50/50/0 

£29 

l 

67/0/67  40/20/0 

£46  1 

67/J3/33 

40/40/0 

2 

100/100/0 

2 

50/100/0 

£47  l 

33/31/67 

0/20/40 

2 

50/100/50 
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The  set  of  three  numbers  in  the  "On  Target"  column  indicate 
percentage  of  first,  second,  and  third  choice  correct  answer.  Por 
example,  for  test  set  REFM13.FLR,  target  1,  the  "on  target" 
percentage  for  first  choices  is  100  percent,  second  choices  is  67 
percent,  and  third  choices  is  33  percent. 

Note,  however,  that  the  correctness  of  "on  target"  only 
indicates  that  the  choices  for  first,  second,  and  third  correspond 
to  the  target  region  and  not  the  specific  location  within  that 
target . 

The  last  coluam  set  of  three  numbers  correspond  to  percent 
correct  in  the  first  choice,  the  second  choice,  and  the  third  choice 
for  the  detailed  sub-structures.  For  example,  using  test  set 
REPM13.PLR,  60  percent  of  the  first  choices  are  correct  and  40 
percent  of  the  second  choices  are  correct.  Consequently,  zero 
percent  of  the  third  choices  will  be  correct. 

The  overall  performance  of  this  method  to  detect  correct 
target  is  0.589.  This  number  was  calculated  by  adding  the  first 
choice  percentages  in  the  "on  target"  column,  dividing  by  the  total 
number  of  PLIR  images  tested  (27),  then  dividing  by  the  maximum 
possible  score  (200).  The  overall  performance  of  this  method  to 
detect  detailed  sub-structures  is  0.229.  This  number  was  calculated 
by  adding  the  first  choice  percentages  in  the  "Detailed 
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Substructure”  column,  dividing  by  the  total  number  of  PLIR  images 
tested  (27),  then  dividing  by  the  maximum  possible  score  (200). 

These  results  suggest  that  classification  of  targets  within 
cluttered  PLIR  images  is  possible  using  Gabor  transform 
coefficients.  However,  the  detailed  substructure  of  targets  may  not 
be  classified  using  this  technique.  These  results  also  suggest  that 
the  Gabor  coefficients  should  be  an  adequate  feature  to  train  a 
neural  network  such  as  a  kth-nearest  neighbor  network. 

Kth-Nearest  Neighbor  Approach. 

The  kth-nearest  neighbor  network  approach  used  the  same  jet 
vectors  as  used  in  the  multi-layer  perceptron  approach.  The  first 
nearest  neighbor  accuracy  was  0.2786.  The  third  nearest  neighbor 
accuracy  was  0.3500.  The  fifth  nearest  neighbor  accuracy  was 
0.3930.  The  seventh  nearest  neighbor  accuracy  was  0.3071.  The 
ninth  nearest  neighbor  accuracy  was  0.2786. 

These  results  indicate  that  the  ability  of  the  nearest 
neighbor  network  to  correctly  identify  jet  vectors  is  better  than 
chance,  but  still  poor,  at  best.  Although  the  accuracies  calculated 
are  low,  insight  may  be  gained  by  looking  at  the  confusion  matrix 
(the  network's  choices  versus  the  actual  vector  classifications). 

Table  4  shows  the  confusion  matrix  associated  with  the  fifth 
nearest  neighbor  calculated  classifications  and  accuracies.  Each 
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Table  4.  Confusion  Matrix  for  Fifth  Nearest  Neighbor 
Calculations . 

ACTUAL  CLASSIFICATION 

0  12  3  4 

NETI01I  0  IS  3  6  3  2 

OUTPUT 


1  2  10  11  5  T 


2  4  8(34 


3  4  3  2  14  6 


4  3  4  3  3  9 


column  corresponds  to  the  actual  clasaif ication  of  the  jet  vector. 
Bach  row  corresponds  to  the  network  output  classification.  The 
values  entered  into  this  matrix  indicate  how  many  times  the  network 
chose  a  certain  class  relative  to  the  actual  classification  of  the 


jet  vector. 


If  the  network  was  perfectly  correct,  the  off  diagonal  values 
would  be  zero  and  the  diagonal  values  would  be  maximum.  As  the 
values  indicate,  all  but  one  diagonal  value  is  the  maximum. 

Class  zero  were  correctly  identified  15  times  out  of  28. 
Class  one  vectors  were  correctly  identified  10  times  out  of  28,  but 
confused  for  class  two  vectors  8  times  out  of  28. 

Class  two  vectors  were  correctly  identified  6  times  out  of  28, 
being  confused  for  class  one  vectors  11  times  and  class  zero  vectors 
6  times  out  of  28. 

Class  three  vectors  were  correctly  identified  14  times  out  of 
28,  being  confused  for  class  one  vectors  5  times  out  of  28. 

Class  four  vectors  were  correctly  identified  9  times  out  of 
28,  being  confused  for  class  one  vectors  7  times  out  of  28. 

Recall,  the  class  zero  designation  corresponded  to  the  mid 
hull  of  the  side  viewed  tank,  foreground.  Apparently,  the  jet 
vector  recognition  scheme  is  not  readily  confused  when  identifying 
this  particular  target  substructure. 

Class  one  designation  corresponded  to  rear  cog  of  the  side 
viewed  tank,  foreground.  This  type  of  target  substructure  can  be 
confused  with  class  two  designations,  front  cog  of  side  viewed  tank, 
foreground.  This  result  is  not  unexpected  since  the  front  cog  of 
a  tank  is  similar  in  structure  to  the  rear  cog  of  a  tank. 
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Class  two  designation  corresponded  to  front  cog  of  the  side 
viewed  tank,  foreground.  This  type  of  target  substructure  is 
readily  confused  with  the  rear  cog  of  the  side  viewed  tank 
foreground.  The  confusion  with  the  rear  cog  is  to  be  expected  as 
previously  explained. 

Class  three  designation  corresponded  to  left  tread,  front 
viewed  tank,  foreground.  This  type  of  target  substructure  can  be 
confused  for  the  mid-hull  and  the  rear  cog  equally  likely.  This  may 
be  explained  by  the  horizontal  construction  of  the  tread  and  its 
apparent  likeness  to  the  horizontal  construction  of  the  ^'d  hull. 
Note  also  that  the  rear  cog  jet  vector  components  encompass  not  only 
the  rear  cog  but  also  part  of  the  rear  hull  region.  Apparently, 
sufficient  correlation  with  the  rear  hull  may  be  found  in  the  rear 
cog  jet  vectors  to  provide  the  confusion  indicated  for  class  three 
designated  targets. 

Class  four  designation  corresponded  to  the  right  tread  of  the 
front  viewed  tank,  foreground.  Class  four  targets  may  be  confused 
as  class  one  targets.  The  explanstion  for  class  three  targets  hold 
t-ue  for  class  four  targets. 

The  significant  feature  of  the  values  found  in  Table  4  is  that 
the  diagonal  values  are  the  highest  values  in  the  matrix,  with  one 
notable  exception  (values  corresponding  to  class  two  targets).  This 
trend  indicates  that,  although  the  overall  accuracy  was  poor. 
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(0.3930),  individual  classifications  were  essentially  correct.  The 
confusion  between  class  one  (rear  cogs)  and  class  two  (front  cogs) 
targets  can  be  explained  by  the  similarity  in  structure  between 
front  and  rear  cogs . 

Another  problem  with  this  particular  application  of  jet  vector 
classification  involves  the  jet  construction,  obtaining  vector 
components  from  Gabor  functions  that  are  "too  small". 

If  the  Gabor  function  is  significantly  smaller  than  the  object 
its  centered  on,  the  values  for  correlation  wiii  become  highly 
susceptible  to  ssiall  changes  in  position  and  aspect  rotation  (out 
of  plane  rotation). 

The  jet  vectors  used  to  train  and  test  the  multilayer 
perceptron  were  comprised  of  Gabor  coefficients,  half  of  which  were 
derived  from  Gabor  functions  whose  main  lobe  was  considerably 
smaller  than  the  target  of  interest.  Therefore,  half  of  the  jet 
vector  components  are  highly  susceptible  to  small  changes  in 
position  and  aspect  angle. 

The  results  of  reducing  the  input  vectors  to  four  components, 
those  corresponding  to  the  16  by  16  Gabor  size  correlations  (Table 
5,  row  2)  and  8  by  8  (Table  5,  row  3),  produced  nearest  neighbor 
accuracies  less  than  those  for  the  eight  inputs  (Table  5,  row  1). 

The  8  by  8  vector  components  used  as  input  are  highly 
susceptible  to  slight  variations  in  position  and  aspect  angle,  thus 
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Table  5.  Nearest  Neighbor  Accuracies  £or  eight  vector 
component  input,  four  vector  component  input  (16  by 
16),  and  four  vector  component  input  (8  by  8). 


1  NN 

3  NN 

5  NN 

7  NN 

9  NN 

m 

0.2736 

0.3500 

0.3930 

0.3071 

0.2786 

ss 

0.2143 

0.2857 

0.3143 

0.3000 

0.3000 

0.2500 

0.3000 

0.2786 

0.3071 

0.3143 

VOD 

0.3286 

0.2786 

0.3571 

0.3714 

0.357  1 

SS 

0.2786 

0.3000 

0.26(3 

0.2643 

0.2571 

0.2286 

0.2000 

0.2000 

0.2500 

0.2357 

3  el. 

0.4286 

0.4500 

0.4643 

0.4930 

0.4571 

2  cl. 

O.S786 

0.5929 

0.6000 

0.6214 

0.5929 

explaining  the  lower  accuracies  for  nearest  neighbor  calculations. 

Recall,  all  eight  vector  components  were  scaled  between  zero 
and  one  using  equation  8.  The  16  by  16  vector  components  were 
scaled  accordingly,  thereby,  being  effected  of  the  8  by  8  vector 
components  to  a  greater  extent.  This  may  explain  the  reduction  in 
classification  accuracy  when  using  the  16  by  16  vector  components 
as  input. 

Jet  vectors  were  generated  from  the  correlation  coefficients 
between  the  PLIR  image  and  the  modified  Gabor  functions.  The 
modified  Gabor  functions  consisted  of  three  cycles  per  envelope, 


orientations  0,  45,  90,  and  135  degrees,  dilations  16  by  16  and  8 
by  8. 

Under  these  conditions,  the  K-Nearest  Neighbor  calculations 
produced  accuracies  of  0.3286  for  the  first  nearest  neighbor,  0.2786 
for  three  nearest  neighbors,  0.3571  for  five  nearest  neighbors, 
0.3714  for  seven  nearest  neighbors,  and  0.3571  for  nine  nearest 
neighbors  (Table  5,  row  4). 

Again,  reducing  the  number  of  inputs  to  those  corresponding 
to  16  by  16  (Table  5,  row  6)  or  8  by  8  (Table  5,  row  7)  produced 
significantly  decreases  in  accuracies. 

In  an  effort  to  increase  the  accuracy  of  classification,  the 
number  of  classes  was  reduced  to  three  (Table  5,  row  7)  and  two 
(Table  5,  row  8).  The  three  class  problem  reduced  the  number  of 
classes  to  mid-hull,  side  viewed  tank,  foreground  (class  0),  cogs, 
side  viewed  tank,  foreground  (class  1),  and  treads,  front  viewed 
tank,  foreground  (class  2).  As  is  readily  evident,  by  reducing  the 
number  of  classes,  the  accuracy  of  classification  increased,  ranging 
from  0.4286  (first  nearest  neighbor)  to  0.4929  (seven  nearest 
neighbors) . 

The  two  class  problem  reduced  the  classes  to  side  viewed  tank, 
foreground  (class  0)  and  front  viewed  tank,  foreground  (class  1) . 
The  accuracy  increased,  ranging  from  0.5786  (first  nearest  neighbor) 
0.6214  (seven  nearest  neighbors). 


To  sumnarize  this  portion  of  the  feasibility  study, 
classification  based  on  Gabor  coefficients  is  mediocre,  at  best. 

These  results  should  not,  however,  preclude  further 
investigation.  Preliminary  results  on  the  use  of  Gabor  coefficients 
as  classification  features  indicate  promise.  With  the  proper 
adjustments  of  the  parameters ,  Gabor  jet  coefficients  may  be  capable 
of  accuracies  well  above  those  shown  in  this  thesis. 
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Part  3.  DESIGN  OF  AN  OPTICAL  GABOR  TRANSFORM  SYSTEM. 

As  an  alternative  method  for  generating  the  Gabor 
coefficients,  an  optical  Gabor  transform  design  is  presented. 

The  design  of  the  an  optical  Gabor  transform  system  begins 
with  a  discussion  of  wavefront  reconstruction  and  computer  generated 
holograms. 

Computer  Generated  Holograms.  The  concept  of  holograms  came 
about  in  1948  when  Dennis  Gabor  proposed  an  imaging  process  called 
wave  front  reconstruction:  interference  between  a  coherent 
reference  wave  and  the  diffracted  light  from  an  object  captured  on 
photographic  film,  holography,  followed  by  re-transmission  of  the 
image  based  on  the  interference  fringes  recorded  on  the  film. 

Coherent  wave  fronts  necessitate  the  recording  of  amplitude 
and  phase  information  about  the  waves.  By  interfering  a  known 
wavefront  (reference  beam)  with  an  unknown  wavefront  (diffracted 
light  from  an  object),  the  pattern  captured  on  photographic  film 
will  be  a  function  of  the  amplitude  and  phase  of  the  unknown 
wavefront.  Consider  an  unknown  wavefront, 

U(x,y)  =  U(x,y)  e(*Mx»y))  (11) 
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where  u(x,y)  is  the  amplitude  and  #(x,y)  is  the  spatial  phase  of  the 
unknown  wavefront. 

Let  the  reference  wavefront  be 

R(x,y)  =  R(x,y)  e^-^***^  (12) 

where  R(x,y)  is  the  amplitude  and  fi(x,y)  is  the  spatial  phase  of  the 
reference  wavefront . 

When  R(x,y)  interferes  with  U(x,y),  the  resulting  intensity 
pattern  will  be 

i(*,y)  =  |R(*»y)|2  ♦  |U(x,y)|2 

♦  2R(x,y)U(x,y)cos(fi(x,y)  -  #(x,y))  (13) 

where  the  first  two  terms  are  intensity  dependent  and  the  third  term 
includes  the  difference  between  the  spatial  phases  of  the  reference 
and  unknown  wavefronts . 

Once  I(x,y),  the  hologram  of  the  unknown  object,  has  been 
recorded,  the  transparency  of  the  hologram  is  illuminat**!  by  the 
reference  beam  to  reconstruct  the  unknown  wavefront.  The  resulting 
transmission  wavefront  will  consist  of  four  terms 
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R(x,y)  T f(x,y)  =  T^R  ♦  B'UU*R  +  B’R*RU  ♦  B'RRU*  (14) 

=  A1+A2  +  A3  +  A< 

where  T f(x,y)  is  the  amplitude  transmittance  of  the  film  which  is 
comprised  of  a  uniform  "bias"  transmittance,  Tfr,  set  by  the 
reference  and  a  "slope-exposure  time"  term,  B'  (scalar),  taken  from 
the  t-E  curve  for  the  photographic  film. 

The  second  term,  A2,  is  the  reference  wavefront  scaled  by 
B*|U(x,y)|^.  The  third  term,  A3,  is  the  unknown  wavefront  scaled  by 
B'(x,y) |R(x,y)|^.  The  fourth  term  is  a  combination  of  the  unknown 
and  reference  wavefronts 

A4  =  (R(x,y))^  e("j26(x,y))  u(x,y)  (15) 

and  is  a  function  of  both  the  reference  and  unknown  wavefronts 
(8:198-273). 

The  third  term  is  of  interest  since  it  possesses  a  scaled 
version  of  the  unknown  wavefront.  Figure  4.12a/b  depicts  the  two 
step,  wavefront  reconstruction  process.  In  figure  4.12a,  the 
interference  between  the  unknown  wavefront  and  the  reference 
wavefront  creates  the  fringe  pattern  recorded  on  film.  In  figure 
4.12b,  the  film  is  illuminated  by  the  reference  beam  to  transmit  the 
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REFERENCE  WAVEFRONT 


|  « 

HOLOGRAPHIC  FILM  LJ 


Figure  4.12.  Wavefront  reconstruction:  Holography, 
(a)  Creating  the  interferogram.  (b)  Reconstructing 
the  hologram  of  the  object  via  illumination. 
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unknown  object  beam.  Note  the  incident  angle  of  the  reference 
wavefront  relative  to  the  object  wavefront  in  both  13a  and  13b. 

The  concept  of  wavefront  reconstruction  can  be  simulated  using 
a  computer  generated  hologram.  The  pattern  resulting  from  the 
interference  between  a  reference  beam  and  an  object  of  interest  is 
comprised  of  magnitude  and  phase.  Often,  the  magnitude  and  phase 
of  individual  points  can  be  digitally  calculated  and  plotted  as  a 
real,  non-negative  function  using  a  plotting  device.  The  resulting 
plotted  image  can  then  be  photoreduced  onto  film  to  produce  a 
transparency  for  use  in  an  optical  system  (19:153-192) 

The  computer  generated  hologram  for  the  cosine  Gabor  functions 
are  degenerate  in  the  sense  that  the  magnitude  of  the  function  will 
produce  a  sufficient  focal  plane  filter  to  perform  optical  Gabor 
transforms. 

Figure  4.13  depicts  the  proposed  design  for  optical  Gabor 
transf onset ion.  A  Helium  Neon  (He-Ne)  laser  beam  is  expanded 
(collimated)  and  isgtinges  on  a  transparency  of  the  target  image 
which  resides  in  the  front  focal  plane  of  a  Fourier  transforming 
lens. 

The  target  image  is  Pourier  transformed.  In  the  back  focal 
plane  of  the  Fourier  transforming  lens  is  a  computer  generated 
hologram  of  the  cosqplex  conjugate  of  the  Fourier  transform  of  the 
Gabor  function  (see  inset.  Figure  4.13). 
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Figure  4.13.  Schematic  for  proposed  optical  Oabor 
transform  system.  Collimator,  Fourier  transforming 
lens.  Hologram  plane,  Pourier  transforming  lens. 
Camera. 


A  significant  difference  between  the  optical  implementation 
and  the  digital  implementation  is  that  the  optical  implementation 
will  superimpose  images  based  on  ''ouplex  fields.  The  digital 
implementation  superimposes  images  based  on  intensities.  Therefore, 
if  the  optical  implementation  is  to  work,  the  fields  must  add 
coherently  to  provide  segmentation. 

One  possible  way  of  implementing  the  optical  Gabor  filter  is 
to  selectively  introduce  the  Gabor  orientations  and  frequencies  such 
that  only  one  set  of  Gaussian  "circles"  are  present  during  each  run. 
The  resulting  correlation  image  can  be  sensed  by  the  CCD  camera 
after  the  second  Fourier  lens. 

A  point  for  point  multiplication  will  take  place  at  the  back 
focal  plane  of  the  Fourier  transforming  lens.  Recall,  point  for 
point  multiplication  of  the  Pourier  transform  of  the  input  image 
with  the  complex  conjugate  of  the  Fourier  transform  of  the  Gabor 
function  results  in  correlation  after  inverse  Pourier 
transformation . 

The  back  focal  plane  product  is  Fourier  transformed  through 
another  Pourier  transforming  lens  and  imaged  onto  a  CCD  camera.  The 
signal  processing  from  the  CCD  camera  to  the  video  display  will  flip 
the  image  about  the  x  and  y  axes  to  properly  display  the  image. 

As  each  orientation  and  frequency  is  produced,  the  signal 
processing  and  storage  of  images  can  be  accomplished.  After  the 
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desired  number  of  orientations  and  frequencies  are  produced, 
superposition  of  the  images  can  be  accomplished.  This  will 
effectively  be  the  optical  implementation  of  the  digital  simulation 
presented  in  this  thesis. 


i 
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Conclusion. 

The  first,  and  foremost,  task  of  any  target  recognition  and 
classification  system  is  to  segment  the  target  from  the  background. 
However,  segmentation  is  not  a  trivial  task. 

One  method  for  image  segmentation  discriminates  based  on 
frequency  content  and  its  corresponding  distribution  within  an 
image.  Gabor  transforme  use  these  image  features  to  provide  a  means 
for  discriminating  regions  of  interest  (regions  of  relatively  high 
intensity)  from  less  interesting  regions  (regions  possessing  less 
intensity)  within  FLIR  images. 

Gabor  transforms  use  linear  Fourier  transform  techniques  to 
segsmnt  images,  which  significantly  reduces  the  computational 
expense  and  complexity  as  opposed  to  those  proposed  by  earlier 
researchers  attempting  FLIR  image  segmentation. 

Gabor  tranaforaw  do  not  require  a  priori  information  to 
segment  effectively.  Hence,  a  detection  system  using  Gabor 
transforms  should  function  in  environments  where  information  is  not 
readily  available,  such  as  in  the  front  end  of  a  "smart"  missile 
acquiring,  tracking,  and  guiding  to  termination  autonomously. 

The  dilating  nature  of  the  self  similar  and  modified  self 
similar  Gabor  functions  is  important  from  the  standpoint  of  terminal 


guidance.  A  missile  may  acquire  a  target  several  kilometers  away. 
As  such,  the  target  may  appear  to  be  a  small  "blob".  However,  as 
the  missile  begins  descending  onto  the  target,  the  target  size  will 
increase  relative  to  the  missile’s  field  of  view.  The  segmentation 
schesm  must  take  into  account  this  change.  Since  Gabor  functions 
can  dilate  (expand  or  contract)  depending  on  the  size  of  the  target, 
they  can  easily  accommodate  dynamic  changes  in  target  size. 

Gabor  transforms  are  extremely  sensitive  to  spatial 
frequencies  and  their  respective  orientations.  For  instance, 
frequency  3,  orientations  45  and  135  degrees  provide  effective 
segmentation  of  some  of  the  FLIR  images  whereas  frequency  3, 
orientations  0  and  90  degrees  provide  effective  segmentation  for 
others.  In  some  instances,  frequency  4  provide  more  effective 
segmentation  than  frequency  3. 

Consequently,  constructing  a  filter  which  possesses  several 
orientations  and  several  frequencies,  such  as  that  proposed  in  the 
optical  Gabor  design,  will  be  very  specific  in  its  spatial  frequency 
and  orientational  correlation.  The  filter  will  ring,  so  to  speak, 
within  very  specific  regions,  hence  segmentation  is  possible. 

Sine  wave  Gabor  functions  are.  edge  detectors,  whereas  cosine 
Gabor  functions  tend  to  "fill  in"  regions  of  relatively  slow  change. 
Mote,  though,  that  both  the  sine  wave  and  the  cosine  wave  Gabor 
functions  are  subject  to  a  global  average  intensity.  This 
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dependency  may  reduce  the  Gabor  function's  effectiveness  to 
discriminate  low  intensity  targets.  Therefore,  "Lambertization"  of 
the  image  may  be  required  prior  to  Gabor  transformation  (See 
Appendix  0  for  details  on  Lambertization). 

By  combining  sine  wave  Gabor  functions  with  cosine  wave  Gabor 
functions,  complete  segmentation,  edge  detection  with  body  filling, 
of  FLIR  images  is  accomplished. 

Gabor  transforms  have  proven  extremely  useful  for  segmenting 
the  FLIR  images  used  in  this  research.  The  techniques  used  for 
classification  produced  proeusing  results.  Preliminary  indications 
show  that,  with  proper  adjustment,  the  Gabor  based  classification 
system  may  produce  increased  classification  accuracy(ies) . 

In  summary,  the  results  of  this  research  effort  show  that 
Gabor  transforms  provide  a  fast,  complete  linear  segmentation  scheme 
and  may  very  well  become  the  pre-filtering  standard  for  all  image 
processing  techniques. 
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Digital  Research. 

Modified  Self  Similar  Gabor  Functions.  Interesting  future 
research  using  the  digital  implementation  of  Gabor  transforms  may 
include  varying  the  number  of  cycles  under  the  Gaussian  envelope  of 
the  self  similar  Gabor  function,  yet  retain  its  dilating  nature. 
Including  this  feature  using  self  similar  Gabor  functions  renders 
them  useful  for  segmentation,  thereby  combining  the  "best"  features 
of  both  the  self  similar  and  non-self  similar  Gabor  functions. 
Results  indicate  that  combining  the  non-self  similar  features  with 
self  similar  features  result  in  an  excellent  segmenter  (See  Appendix 
M). 

Multi -Sensor  Fusion  Analog.  Another  area  of  interest  may 
include  developing  digital  simulations  of  a  multi-sensor  fusion 
Gabor  segmenter  based  on  FLIR  and  Laser  Designated  Range  (LADAR) 
information  in  an  effort  to  improve  the  efficiency  and  accuracy  of 
detection  and  classification. 

Vector  Space  Harping  for  Classification.  Vector  space  warping 
is  an  effort  to  make  the  jet  vector  approach  for  classification 
scale  invariant. 

The  idea  is  patterned  after  a  speech  recognition  scheme  called 
time  warping.  Speech  signals  of  the  same  utterance  are  variable  in 
duration.  Hence,  to  correctly  identify  specific  speech  utterances. 
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the  feature  used  for  recognition  must  be  variable.  A  difficulty 
with  time  warping  is  temporal  alignment  of  the  speech  signals.  Once 
aligned,  the  test  vectors  (of  length  N)  are  compared  to  the  template 
vector  (of  length  M) .  Simplistically  speaking,  the  vector 
comparison  producing  the  minimum  distance  trajectory  along  the 
diagonal  (or  closest  to  the  diagonal)  of  the  N  by  N  matrix  should 
correspond  to  the  correct  word.  For  a  more  in-depth  discussion  of 
dynamic  time  warping  refer  to  Rabiner,  et.  al.  (17:575-582). 

Similarly,  same  objects  can  have  different  sizes,  depending 
on  range  of  view,  and  the  metric  used  for  determining  what  these 
objects  are  should  account  for  this  change. 

Recall,  the  jet  vector  approach  adopted  for  this  research  used 
eight  components,  four  orientation*  at  a  Gabor  window  size  of  16  by 
16  and  four  orientations  at  a  Gabor  window  size  of  8  by  8, 
irrespective  of  the  target  size  (range). 

Targets  further  down  range  from  the  FLIR  detector  platform 
could  not  be  reliably  identified  using  Gabor  correlation 
coefficients,  although  they  could  readily  be  segmented  using  Gabor 
transforms.  This  was  due,  in  part,  to  the  fact  that  over  fifty 
percent  of  the  pixels  within  the  16  by  16  window  sizes  corresponded 
to  surroundings  and  not  the  target. 

Hence,  only  four  coefficients  should  be  used  to  identify  the 
targets  further  down  range.  The  question  is  raised,  "  How  can  we 
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compare  down  range  tank  vectors  to  up  range  tank  vectors  ?  ".  A 
means  for  comparing  down  range  target  vectors  to  up  range  target 
vectors  should  be  developed.  One  possible  means  of  accomplishing 
this  task  is  to  employ  vector  space  warping,  comparing  four 
dimensional  vectors  to  eight  dimensional  vectors  using  a  similar 
technique  as  time  warping. 

Neural  Networks.  Neural  networks  are  devices  which  employ 
densely  interconnected,  simple  computational  units  called  neurons. 
These  neurons  are  usually  connected  to  form  distinct  layers,  such 
as  can  be  found  in  a  multilayer  perceptron  network  (14:1-136). 

Multilayer  PercePtron  Approach.  The  multilayer  perceptron  has 
an  input  layer,  two  or  more  inner  or  hidden  layers,  and  an  output 
layer.  Bach  node  within  a  layer  is  connected  to  nodes  in  the 
previous  layer.  The  connections  are  weighted,  initially,  in  a 
random  manner  with  low  values  (between  0.1  and  0.5).  The  network 
is  given  a  set  of  inputs  on  which  to  train. 

The  output  is  compared  with  the  input  and  the  weights  are 
changed.  This  process  is  continued  until  the  network  "settles”  on 
an  answer. 

The  input  to  the  multilayer  perceptron  can  be  the  eight  vector 
components  derived  from  the  jets.  Bach  of  the  eight  input  nodes 
can  be  connected  to  ten  nodes  in  the  first  hidden  layer.  Each  of 
the  first  hidden  layer  nodes,  in  turn,  can  be  connected  to  ten  nodes 
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in  a  second  hidden  layer.  Bach  node  in  the  second  hidden  layer  can 
be  connected  to  an  output  layer  containing  five  nodes  (each  node 
corresponding  to  one  of  the  five  locations  determined  by  the  eight 
dimensional  jet  vector  approach). 

Optical  Research. 

Non-linear  Crystals.  The  use  of  non-linear  crystal  media  such 
as  Lithium  Niobate  or  Barium  titanate  may  replace  the  computer 
generated  hologram  filter  approach  to  allow  for  near  real-time 
holography.  Por  more  information  about  non-linear  crystals,  two 
text  books  are  excellent  references  (24:1-156,  25:1-589). 
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Appendix  A.  Glossary  of  terms 


1.  Computer  generated  holograms  -  computer  renderings  of 
objects  which,  when  illuminated  by  coherent  beams  (laser  beams), 
generate  a  complete  "three-dimensional"  image  of  the  object.  It 
should  be  noted  that  Dennis  Gabor  is  famous  for  being  one  of  the 
"founding  fathers"  of  holography. 


2.  Digital  images  -  an  image  whose  intensity  is  divided 
into  a  discrete  valued  array  of  elements  which,  when  arranged 
properly,  reconstruct  the  image. 


3.  Past  Pourier  Transform  (PPT)  -  the  decomposition  of  a 
discrete  Pourier  transform  into  smaller  transforms  then  recombining 
them  to  produce  the  complete  Pourier  transform  of  the  image. 
Conmonly  called  decimation  in  frequency  or  decimation  in  time 
transforms  popularized  by  Cooley  and  Tukey  (3:297-301). 


4.  Forward  Looking  InfraRed  (PLIR)  -  a  technique  for 
detecting  targets  by  the  thermal  gradient  between  the  target  and  its 
surroundings . 


5.  Fourier  Transform  -  a  method  to  convert  a  space  (time) 
signal  to  a  spatial  (temporal)  frequency  signal  without  loss  of 
signal  integrity. 


6.  Jet  Vectors  -  A  vector  comprised  of  Gabor  correlation 
coefficients  associated  with  specific  Gabor  function  frequencies  and 
orientations. 


7.  Laser  Designated  Radar  (LADAR)  -  a  device  that 
determines  the  range  between  an  object  and  the  platform  on  which  the 
LADAR  resides  by  illuminating  the  object  with  a  laser  beam. 


8.  Neural  network  -  a  densely  interconnected  set  of  simple, 
computational  elements  called  nodes. 
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9.  Segmentation  -  distinguishing  targets  from  background 
based  on  a  given  feature  such  as  temperature,  range,  planarity,  or 
frequency  content. 


10.  Self  (Non-Self)  Similarity  -  A  characteristic  of  Gabor 
functions  whereby  the  frequency  of  the  sinusoidal  cofactor  is  (is 
not)  a  direct  function  of  or  equivalent  to  the  standard  deviation 
of  the  Gaussian  cofactor.  For  Non-Self  similarity,  the  Gaussian 
standard  deviation  is  fixed  and  the  sinusoidal  cofactor  frequency 
is  allowed  to  vary. 
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Appendix  B.  Speech  signal  processing  using  MathCAD. 


SYNOPSIS:  MathCAD  template  for  calculating  the  correlation  between 
the  utterance  "ONE",  as  spoken  by  Dr.  Matthew  Kabrisky,  and  the  self 
similar  Gabor  function. 

All  input  data  are  entered  into  the  MathCAD  template  using  the 
built  in  function  READ.  The  Fourier  transform  of  the  Gabor  function 
and  the  voice  track  data  is  calculated  using  the  built  in  function 
CFPT,  Complex  Past  Pourier  Transform.  The  Fourier  transform  of  the 
voice  data  is  multiplied  by  the  complex  conjugate  of  the  Pourier 
t  ansform  of  the  Gabor  function.  The  product  of  the  point  for  point 
multiplication  of  the  Fourier  transform  of  the  voice  data  by  the 
complex  conjugate  of  the  Fourier  transform  of  the  Gabor  function  is 
inverse  Pourier  transformed  using  the  built  in  function  ICFFT, 
Inverse  Complex  Fast  Pourier  Transform.  The  results  are  displayed 
using  built  in  graphics  routines. 

INPVT:  Data  from  voice  utterance  sampled  at  16  KHz. 

Gabor  function  data,  Filename!  GBR1.DAT. 

OUTPUT!  The  correlation  between  the  speech  utterance  and  the  Gabor 
function. 
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One  Dimensional  Gabor  Transforms.  Speech  Analysis. 


The  Zenith  model  248  personal  computer  (PC)  was  used  to  generate 
the  one  dimensional  Gabor  transform  analysis  of  the  speech  signal, 
"ONE",  as  spoken  by  Dr.  M.  Kabrisky.  The  primary  mathematical 
program  to  analyze  the  utterance  was  MathCAD,  purchased  from 
Mathsoft,  Inc.,  which  performed  complex  Fourier  transforms,  complex 
inverse  Fourier  transforms,  indexed  data,  and  generated  graphs  for 
display . 

The  Gabor  function  was  generated  for  a  data  block  size  of  512. 
The  Gabor  function  was  Fourier  transformed  using  the  complex  Past 
Fourier  Transform  (CFFT)  algorithm  provided  by  the  MathCAD  software. 
The  transform  of  the  Gabor  function  was  converted  to  its  complex 
conjugate . 

The  word  utterance  "ONE"  was  sampled  at  16  kilohertz  (KHz) 
then  divided  into  blocks  of  512  data  points  (approximately  32 
millisecond  windows).  The  CFFT  routine  was  performed  on  each  block 
of  512  utterance  sample  points.  Then  a  point  for  point 
multiplication  of  the  CFFT  of  the  utterance  with  the  complex 
conjugate  of  the  CPFT  of  the  Gabor  function  was  accomplished.  After 
inverse  complex  Fast  Fourier  transforming  the  product,  the  result 
was  the  correlation  between  the  word  utterance  and  the  Gabor 
function. 
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Index  counter: 


t  :=  0  . .511 


Read  the  speech  utterance:  vl  corresponds  to  the  data  points 
from  1024  to  1535.  v2  corresponds  to  the  data  points  from  1536 
to  2047. 


vl  :=  READ  onelk 
t  kab 


Read  the  Gabor  Function: 

Gabor  :=  READ  fgbrl 

t  L  dat 


v2  :=  READ | one 12  ! 

t  !  kab 


Fourier  transform  of  Gabor  and  voice  tracks 


fgabor  :=  cfft(Gabor)  fvl  :=  cfft(vl)  fv2  :=  cfft(v2) 


0  t  511  0  t  511  0  t  511 


Multiply  the  Fourier  transform  of  v's  with  the  complex  conjugat 
of  the  Fourier  transform  of  Gabor. 


ml  :=  fvl  fgabor  m2  :=  fv2  fgabor 

t  t  t  t  t  t 


Inverse  Fourier  transform  of  the  m  functions 


invml  :=  icfft(ml)  invm2  :=  icfft(m2) 


Appendix  C.  Part  1.  Sine  wave  Gabor  transform  FORTRAN  source  code. 

BSG.POR 

Appendix  C.  Part  2.  Cosine  wave  Gabor  transform  PORTRAN  source 

code. 

BCG. FOR 

SYNOPSIS:  Part  1  /  Part  2.  The  BSG.POR  code  reads  in  image  data 
stored  two  s  complement  BYTE  foraat  and  converts  it  to  integer 
format.  After  reading  in  the  data,  the  program  generates  a  filename 
for  the  Gabor  filtered  image.  Depending  on  the  user's  choice,  the 
program  then  generates  a  self  similar,  modified  self  similar,  or  a 
non-self  similar  Gabor  function  on  center  within  a  256  by  512  pixel 
block.  Several  parameters  are  passed  to  the  Gabor  function 
generating  subroutine.  They  are  the  window  size,  the  frequency  of 
the  sinusoidal  variation  cofactor  (initially  set  to  the  lowest 
frequency  of  interest  then  incremented  according  to  the  user's 
preference),  the  standard  deviation  at  the  N/2  point,  current  in¬ 
plane  rotation  (orientation  of  the  sinusoidal  variation),  and  the 
user's  choice  of  sine  wave  or  cosine  wave  variation  (the  only 
difference  between  part  1  and  part  2  is  this  choice).  The  program 
then  takes  the  Fourier  transform  of  the  image  and  of  the  Gabor 
function,  performs  a  point  for  point  multiplication  of  the  Fourier 
transform  of  the  image  with  the  complex  conjugate  of  the  Fourier 
transform  of  the  Gabor  function ,  then  inverse  Fourier  transforms  the 
product.  The  program  then  sends  the  result  to  the  aforementioned 
output  file.  The  program  continues  until  all  images  of  the 
correlation  between  the  Gabor  functions  possessing  the  frequencies 
and  orientations  of  interest  and  the  raw  FLIR  image  are  generated. 

For  the  readers'  information:  The  MOD  command,  found  in  most 
versions  of  FORTRAN,  takes  the  remeinder  of  the  quotient  of  image 
value  and  256,  then  subtracts  128  from  the  remainder.  Values  in 
excess  of  127  are  "folded  over",  ie.  128  is  equivalent  to  zero, 
using  the  MOD  cossMnd.  This  operation  ensures  the  value  of  the  BYTE 
integer  to  be  within  the  prescribed  range.  It  should  be  noted  that 
the  BYTB  option  for  integer  representation  is  specific  to  VMS 
FORTRAN.  However,  the  LOG I CAL *1  integer  format  can  be  found  in  most 
versiona  of  FORTRAN.  If  the  reader  desires  to  use  the  existing  code 
under  other  operating  systesm,  consult  the  FORTRAN  manual  specific 
to  the  operating  system  to  see  if  BYTE  format  is  a  viable  option. 
If  not,  the  LOGICAL*!  format  should  work. 


INPUT:  Raw  FLIR  image,  240  by  640  pixels 
OUTPUT:  Gabor  filtered  images. 
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nonn 


1 


PROGRAM  GB_MAIN 
DIMENSION 
DIMENSION 
CHARACTER* 2 4 
integer 


NAR( 256, 512 ) ,NMAG( 256 , 512 ) 
GBR ( 256 ,512) ,xar(256,512) 
NAME, NAMEOUT, lml 
pass 


type* , 
type* , 
type* , 
type* , 
type*, 
type* , 
type* , 
type* , 
type* , 
type* , 
type* , 
type* , 
type* , 
type* , 
type* , 
type* , 
type*, 
type* , 
TYPE* , 


********************************************************* 

*  Welcome  to  the  Gabor  transform  program.  This  program  * 

*  will  generate  the  Gabor  transform  of  any  240  by  640,  * 

*  byte  format  image.  If  you  desire  help  before  the  pro-* 

*  gram,  begins  execution,  ie.  before  the  last  prompt,  * 

*  please  type  911  at  the  prompt.  The  help  screen  will  * 


*  be  invoked,  and  you  will  be  able  examine  any  para-  * 

*  meter  for  its  function.  * 

*  Remember,  after  the  program  begins  execution,  you  * 

*  will  not  be  able  to  see  the  help  files.  Also,  you  * 

*  cannot  get  into  the  help  routine  at  the  FLIR  name  * 

*  prompt.  * 

*  This  help  file  is  not  extensive  but  gives  a  brief  * 

*  description  for  each  parameter  the  user  inputs.  * 


9 

-  Kevin  W.Ayer,  CAPT,  USAF 

3  September  1989' 


type* , '  Do 

type*, ' 

read( 5 , * )nhelp 
if (nhelp.eq.911) 
call  help 
endif 


you  wish 
Enter  a 

then 


to  see  the 
911  if  you 


help  files 
so  desire. 


now? ' 


CONTINUE 


- C 

THE  FOLLOWING  PARAMETER  (NAME)  SETS  THE  NAME  C 

OF  THE  INPUT  FLIR  IMAGE  FILE.  C 

- C 

TYPE*, 'NAME  OF  FLIR  IMAGE  TOR  GABOR  TRANSFORMING' 
ACCEPT  30, NAME 


C - C 

C  THE  FOLLOWING  PARAMETERS  SET  THE  NUMBER  OF  C 
C  PASSES  THE  PROGRAM  TAKES  RELATIVE  TO  THE  C 
C  FREQUENCY ( I ES)  OF  INTEREST.  C 
C  THEY  ARE  ALSO  THE  FREQUENCY( IBS ) ASSOCIATED  C 
C  WITH  THE  NON-SELF  SIMILAR  GABOR  FUNCTIONS ).  C 
C - C 


TYPE* , ' LOWEST  FREQUENCY? ' 
READ( 5, * )NLOF 
if (nlof .eq.911 )  then 
call  help 
endif 

TYPE*, 'HIGHEST  FREQUENCY?' 
READ( 5, * )NHIF 


noon  nonoo  nono 


it ( nhif . eq . 911 )  then 

call  help 

endif 


- c 

THE  FOLLOWING  PARAMETER  SETS  THE  STD.  DEV.  OF  C 

THE  SELF  SIMILAR  GABOR  FUNCTION(S).  C 

- c 

TYPE*, 'STANDARD  DEVIATION  AT  THE  MAX  EXTENT?' 

READ( 5 ,  *  ) NLOFl 

i f ( nlof 1 . eq. 911 )  then 

call  help 

endif 


- c 

THE  FOLLOWING  PARAMETERS  ESTABLISH  THE  MAXIMUM  C 
ROTATION  (ORIENTATION)  AND  THE  INCREMENT  OF  C 
ROTATION  FOR  THE  GABOR  FUNCTIONS  (NSS  AND  SS)  C 


TYPE*, 'MAXIMUM  ANGULAR  ORIENTATION  (IN  DEGREES)?' 

READ ( 5 , * ) MAX_ROT 
if (max_rot.eq.911)  then 
call  help 
endif 

TYPE*, ' INCREMENT  OF  ANGULAR  ORIENTATION  (IN  DEGREES)?' 

READ( 5 , * ) INC_ROT 

if ( inc_rot.eq.911 )  then 

call  help 

endif 


- c 

THE  FOLLOWING  PARAMETER  SETS  THE  SIZE  OF  THE  C 

GABOR  ' PATCH ' .  C 

- C 

TYPE*, 'SIZE  OF  THE  GABOR  WINDOW?  MINIMUM-8,  MAXIMUM-128' 

READ( 5 , * )NSIZE 

if (nsize.eq.911)  then 

call  help 

endif 


C - C 

C  THE  FOLLOWING  PARAMETERS  SET  THE  TYPE  OF  GABOR  C 
C  FUNCTION  USED  FOR  IMAGE  PROCESSING.  NCH  SETS  C 
C  THE  SELF  SIMILAR  OR  NON-SELF  SIMILAR  (SS-0,  C 
C  NSS-1 )  AND  NSINNCOS  SETS  THE  SINE  OR  COSINE  C 
C  VARIATION.  C 
C - - C 


TYPE*, 'REGULAR  SELF  SIMILAR-0,  MODIFIED  SELF  SIMILAR-1' 
TYPE*, 'NON-SELF  SIMILAR-2' 

READ( 5 , * )NCH 
if (nch.eq.911 )  then 
call  help 
endif 

type* , ' SEGMENTATION-0 ,  CLASSIFICATION-1 ' 


Rt£AD ( 5, * )NCHSC 
i f ( nchsc . eq . 911 )  then 
call  help 
endi  £ 

TYPE* , 'SINE-0 ,  COSINE-1 ' 
READ( 5 ,  *  ) NSIN_NCOS 
if(nsin  ncos.eq.911)  then 
call  help 
endi  £ 


C - C 

C  NROT  IS  THE  INITIAL  ROTATION  (ORIENTATION).  C 
C  NDIFFl  IS  THE  NUMBER  OF  PASSES  RELATIVE  TO  THE  C 
C  THE  FREQUENCY ( I ES)  OF  INTEREST.  MADIPl  IS  THE  C 
C  NUMBER  OF  PASSES  RELATIVE  TO  THE  NUMBER  OF  C 

C  ORIENTATIONS  OF  INTEREST  SUCH  THAT  THE  TOTAL  C 
C  NUMBER  OF  PASSES  IS  NDIFFl*MADIPl .  C 

C - C 

NROT— 0 

NDIFFP1  -  NHIF  -  NLOF  +  1 

MADIPl  -  MAX_ROT/INC_ROT  +1 

IF(NCHSC.EQ.O)  THEN 
NDIFFPl-2 

ENDIF 

NFLG_FILE  -  0 

NPASS  -  1 


C--  THIS  CALL  STATEMENT  EXECUTES  A  SUBROUTINE  WHICH  — C 

C~  RETRIEVES  A  BYTE  FORMATTED  IMAGE  FROM  MEMORY.  — C 

C—  LMl  IS  THE  FILENAME  FOR  THE  LAMBERTIZED  FLIER  IMAGE  — C 

lml-' lambertl . fir ' 

CALL  GET  FLIR  IM( NAME , NAR, 240,640) 


C—  THIS  CALL  STATEMENT  PUTS  THE  LAMBERTIZED  VERSION  OF  — C 
C —  IMAGE  INTO  FILNAME  LMl .  — C 

CALL  PUT_FL I R_IM ( lml , NAR ,240,640) 

C--  THIS  PORTION  OF  THE  MAIN  PROGRAM  BEGINS  THE  SEQUENCE  — C 
C—  OF  OPERATIONS  NECESSARY  TO  GENERATE  THE  GABOR  COR-  — C 
C—  RELATION ( S )  OF  A  RAW  FLIR  IMAGE.  — C 


DO  10  1-1 , NDI PFPl 
DO  20  J-l, MADIPl 


C—  THIS  CALL  STATEMENT  EXECUTES  A  SUBROUTINE  WHICH  — C 

C—  ESTABLISHES  THE  NAME  OF  THE  GABOR  FILTERED  IMAGE  — C 


CALL  OUT  NAME( NFLG  FI LE , NAMEOUT ) 


no  on 


C —  THESE  CALL  STATEMENTS  EXECUTE  SUBROUTINES  WHICH  — C 
C —  GENERATE  EITHER  SELF  SIMILAR  ( SS ) ,  MODIFIED  SELF  — C 
C —  SIMILAR(MSS) ,  OR  NON-SELF  SIMILAR  (NSS)  GABOR  — C 
C —  FUNCTION ( S )  .  — C 


IF(NCH.EQ.O)  THEN 

CALL  SS_GABOR( GBR , NSI ZE , NLOFl , NROT , NSIN_NCOS ) 
ELSEIF(NCH.EQ.l)  THEN 
CALL  MSS_GABOR( GBR , NSIZE , NLOFl , NLOF , NROT , NSIN_NCOS ) 
ELSE 

CALL  NS S_GABOR ( GBR , NS I Z  E , NLOF , NROT , NS I N_NCOS ) 

END  IF 

—  THIS  CALL  STATEMENT  EXECUTES  THE  GABOR  TRANSFORMATION  — C 

—  SUBROUTINE  WHICH  USES  A  2-D  FFT  SUBROUTINE.  — C 

pass-1 

CALL  GABOR  TRANSFORM ( GBR , NAR , NMAG , 2 56 , 512 , pass ) 


—  THIS  CALL  STATEMENT  EXECUTES  A  SUBROUTINE  WHICH  SENDS  — C 

—  THE  GABOR  FILTERED  IMAGE  TO  MEMORY.  — C 


CALL  PUT  FLIR  IM( NAMEOUT , NMAG , 240 , 640 ) 


NFLG_FILE  -  NFLG_FILE  ♦  1 

C—  THE  ROTATION  IS  INCREASED  BY  THE  INCREMENT  AND  THE  — C 
C—  NUMBER  OF  THE  PASS  IS  INCREMENTED  BY  1  — C 

NROT-NROT+ I NC_ROT 
NPASS  -  NPASS  +  1 

20  CONTINUE 

C—  CHANGE  THE  WINDOW  SIZE  IF  GENERATING  SELF  SIMILAR  — C 

C—  GABOR  FUNCTION (  S  )  .  — C 

IF(NCHSC.EQ.O)  THEN 
NSIZE-NSIZE/2 
END  IF 

C —  RESET  THE  NROT  PARAMETER  TO  ZERO  DEGREES.  — C 

NROT  -  0 
10  CONTINUE 


C —  REQUEST  USER  TO  EXPRESS  DESIRE  FOR  CONTINUING  THE  — C 

C—  PROGRAM.  — c 

TYPE*, 'DO  YOU  WISH  TO  CONTINUE?  NO-O,  YES-1' 

READ ( 5 , * ) NBO 
IF(NBO.EQ.l)  THEN 
GOTO  1 


non  nnn  non 


END  IF 


30  FORMAT ( A2  4 ) 

END 


SUBROUTINE  GET  FLIR  IM( NAME ,AR, ROW  NUM, COL  NUM) 


IMPLICIT 

BYTE 

DIMENSION 

REAL 

REAL 

real 

REAL 

CHARACTER* 2 4 


INTEGER  (A-Z) 

AR  BYTE( 240,640) 

ART256,512) 

TOP ( 512) , BOTTOM ( 512) , THE_MAX , XAR ( 256,512) 
overall  avg, avg( 256,512) ,XTot , the_min 
xl , x2 , xl, x4 , XTOP , XBOTTOM , RTOP , RBOTTOM 
RXAR( 256,512) 

NAME 


C —  OPENS  THE  LOGICAL  UNIT  10  FOR  READING  INFORMATION  FROM  — C 

OPEN ( 10, FILE-NAME, STATUS- 'OLD' , FORM- ' UNFORMATTED ' , 

+  RECORDTYPE- ' VARIABLE ' ,ERR-20) 

20  OPEN( 10, FILE-NAME, STATUS- 'OLD' , FORM- ' UNFORMATTED ' , 

+  RECORDTYPE-' FIXED' ) 


— C 

-  ZEROING  OUT  THE  TRANSFER  DATA  STRUCTURES  — C 

— C 


DO  R-1,256 
DO  C-1,512 

XAR ( R , C ) —0 . 
END  DO 
END  DO 


—  READING  IN  THE  BYTE  FORMATTED  DATA 


DO  100  R-l , ROW  NUM 

READ(10)  (AR_BYTE(R,C) , C-l , COL_NUM ) 
100  CONTINUE 


— C 

—  PUTTING  THE  DATA  INTO  A  256  BY  512  FORMAT  — C 

— C 


RP  -  9 
DO  R-l, 240 

DO  C-65,576 
CP-C-64 

I F ( AR_B YTE ( R , C ) . LT . 0 )  THEN 
AR(RP,CP)-AR_BYTE(R, C)+256 
ELSE 

AR ( RP , CP ) -AR_BYTE ( R , C ) 
ENDIF 
END  DO 


RP-RP+1 
END  DO 


C —  CONVERTING  THE  INTEGER  FORMAT  TO  REAL  FORMAT  — C 

DO  R-1,256 
DO  C-1,512 

XAR(R,C)-REAL(AR(R,C) ) 

END  DO 
END  DO 

Xtot-O . 


C—  FINDING  THE  HIGHEST  AND  LOWEST  PIXEL  INTENSITY  VALUES  — C 

DO  C-1,512 
XTOP-0. 

XBOTTOM- 1000. 

DO  R-1,256 

X2-XAR( R, C ) 

RTOP-XTOP-X2 
RBOTTOM-XBOTTOM-X2 
IF(RTOP.LT.O)  THEN 
XTOP-X2 
ENDIF 

I F ( RBOTTOM . GT . 0 )  THEN 
XBOTTOM-X2 
ENDIF 
END  DO 
TOP ( C ) -XTOP 
BOTTOM(C) -XBOTTOM 
END  DO 


THE_MAX-0 . 

THE_MIN«1000. 

DO  C-1,512 

X3-TOP (C) 

X4-BOTTOM(C) 

XTOP-THE  MAX-X3 
XBOTTOM-fHE  MIN-X4 
IF (  XTOP .  LT .IT )  THEN 
THEMAX-X3 
ENDIF 

I F ( XBOTTOM . GT . 0 )  THEN 
THE_MIN-X4 
ENDIF 
END  DO 


I F ( THE_MAX . EQ . THE  MIN)  THEN 
THE_MAX-THE_MAX+1 . 

ENDIF 


c — 


LAMBERTIZATION  OF  INPUT  FLIR  IMAGE 


—  C 

C —  REQUEST  USER  TO  SPECIFY  IF  LAMBERTI ZATION  IS  DESIRED  — C 

type*, 'DO  YOU  WISH  TO  LAMBERTIZE  THE  IMAGE?  NO-O,  YES-1' 
READ( 5, * )LCH 
IF(LCH.EQ.l)  THEN 

do  i-2,255 
iml-i-1 
ipl-i+1 
do  j-2,511 
jml-j-1 
jpl-j+1 

avg( i , j )-( xar ( iml , jral ) +xar ( iml , j )+xar ( iml , jpl )+ 

+  xar ( i , jml )+xar ( i , jpl )+xar ( ipl , jml )+ 

+  xar (ipl, j)+xar(ipl, jpl ) +XAR( I , J ) )/9. 

end  do 
end  do 

DO  R-1,256 
DO  C-1,512 

RXAR (R, C)-127. +( XAR ( R , C ) - AVG ( R , C ) ) 

END  DO 
END  DO 

ENDIF 


C—  SCALING  THE  PIXEL  INTENSITY  VALUES  BETWEEN  0  AND  255  — C 

DO  R-1,256 
DO  C-1,512 

RXAR (R, C)-255. *( (RXAR(R,C)-THE_MIN)/(THE_MAX-THE  MIN) ) 
AR  (  R , C ) - 1 F I X ( RXAR ( R , C ) ) 

END  DO 
END  DO 

CLOSE ( 10) 

RETURN 

END 


SUBROUTINE  OUT_NAME( NFLG , NAMEOUT ) 
CHARACTER* 2 4  NAMEOUT 


IF(NFLG.EQ.O)  THEN 

NAMEOUT- ' RFl : SFlRO_RJ . FLR' 
ELSEI F ( NFLG. EQ. 1 )  THEN 


NAMEOUT-'RFl :  SF1R4  5_RJ . FLR ' 
ELSEI F ( NFLG . EQ . 2 )  THEN 

NAMEOUT-'RFl : SFlR90_RJ . FLR' 
ELSEIF( NFLG. EQ. 3 )  THEN 

NAMEOUT- ' RFl : SFlRl35_RJ . FLR' 
ELSEIF(NFLG.EQ.4)  THEN 

NAMEOUT- ' RFl : SF1R0_RJ . FLR ' 
ELSEI F( NFLG. EQ. 5 )  THEN 

NAMEOUT-'RFl :SF1R45_RJ. FLR' 
ELSEI F ( NFLG. EQ. 6 )  THEN 

NAMEOUT- ' RFl : SF1R90_RJ . FLR ' 
ELSEI F( NFLG . EQ . 7 )  THEN 

NAMEOUT-'RFl :SF1R1 3 5_RJ. FLR' 
ELSEI F ( NFLG . EQ . 8 )  THEN 

NAMEOUT- ' RFl : SF1R0_RJ . FLR ' 
ELSEIF(NFLG.eQ.9)  THEN 

NAMEOUT- ' RFl : SF1R4  5_RJ . FLR' 
ELSEI F( NFLG . EQ . 10 )  THEN 

NAMEOUT-'RFl :SF1R90  RJ.FLR' 
ELSEI F ( NFLG . EQ . 11 )  THEN 

NAMEOUT- ' RFl : S  FlRl 3  5_R J . FLR ' 
ELSEIF(NFLG.EQ.12)  THEN 

NAMEOUT- ' RFl : SF1R0_RJ . FLR ' 
ELSEIF(NFLG.EQ.13)  THEN 

NAMEOUT- ' RFl : SFlR45_RJ . FLR ' 
ELSEI F( NFLG. EQ. 14 )  THEN 

NAMEOUT- ' RFl : SFlR90_RJ . FLR' 
ELSEI F( NFLG . EQ. 15 )  THEN 

NAMEOUT-' RFl :SF1R135_RJ. FLR' 
ELSEI F( NFLG. EQ. 16)  THEN 

NAMEOUT- ' RFl : SFlR0_RJ . FLR ' 
ELSEI F( NFLG. EQ . 17 )  THEN 

NAMEOUT-'RFl :SF1R4 5  RJ.FLR' 
ELSEI F( NFLG. EQ . 18 )  THEN 

NAMEOUT- ' RFl : SFlR90_RJ . FLR' 
ELSEIF(NFLG.EQ.19)  THEN 

NAMEOUT-'RFl :SFlRl 35  RJ.FLR' 
ELSEI F( NFLG. EQ. 20 )  THEN 

NAMEOUT- ' RFl : SFlR0_RJ . FLR' 
ELSEI F( NFLG. EQ. 21 )  THEN 

NAMEOUT- ' RFl : SF1R4  5_RJ . FLR' 
ELSEI F ( NFLG. EQ. 22 )  THEN 

NAMEOUT- ' RFl s  SFlR90_RJ . FLR' 
ELSEI F( NFLG. EQ . 23 )  THEN 

NAMEOUT-'RFl : SF1R135_RJ . FLR' 
ELSEI F( NFLG . EQ. 24 )  THEN 

NAMEOUT-' RFl ;SF1R0  RJ.FLR' 
ELSEIF(NFLG.EQ.25)  thIn 

NAMEOUT-'RFl jS FI R4 5  RJ.FLR' 
ELSEI F( NFLG . EQ. 26 )  THEN 

NAMEOUT-' RFl :SF1R90  RJ.FLR' 
ELSEI F( NFLG. EQ. 27 )  THEN 

NAMEOUT-' RFl :SFlRl 3 5_RJ. FLR' 
ELSEI F ( NFLG . EQ . 28 )  THEN 

NAMEOUT-' RFl :S FI R0  RJ.FLR' 
ELSEI F( NFLG. EQ. 29 )  THEN 

NAMEOUT-'RFl ;SF1R45  RJ.FLR' 
ELSEI F( NFLG. EQ. 30 )  THEN 

NAMEOUT-' RFl :SF1R90  RJ.FLR' 


El.SE 

NAMEOUT- ' RFl : SFlRl 3  5_RJ . FLR ' 
ENDIF 

RETURN 

END 


SUBROUTINE  SS_GABOR ( GBR ,N,M, NROT ,  NSC ) 

INTEGER  R,C,RG,CG,RGPN,CGPN 

DIMENSION  NGBR( 256,512) ,GBR( 256 , 512 ) 

DIMENSION  TOP( 512 ) 

COMPLEX  CMPLX , CNUM 


C —  ESTABLISH  CONTANTS  AND  PARAMETERS  — C 

PI-3.141592654 

FREQ-FLCAT(M) 

ANGLE- FLOAT ( NROT ) 


C—  ESTABLISH  THE  CENTERING  OF  THE  GABOR  FUNCTION  — C 

RG-127-N/2 

RGPN-RG+N 

CG-255-N/2 

CGPN-CG+N 


C —  ZERO  OUT  THE  GBR  TRANSFER  DATA  STRUCTURE  — C 


DO  R-1,256 

DO  C-1,512 
GBR( R, C ) -0 
END  DO 
END  DO 


C —  CONVERT  FROM  DEGREES  TO  RADIANS  — C 
THETA-ANGLE*PI/180 . 


RG-127-N/2 

MNY-N/2-N 


C —  CHOOSE  BETWEEN  COSINE  OR  SINE  WAVE  SELF  SIMILAR  GABOR  FUNCITON  — C 


IF(NSC.EQ.l)  THEN 


C —  BEGIN  GENERATING  THE  COSINE  GABOR  FUNCTION  — C 

DO  1*1 ,  N 

CG-255-N/2 

MNX-N/2-N 

DO  J-1,N 

C—  ESTABLISH  THE  ROTATION  VARIABLE  XP  --C 

XP-( FLOAT(MNX)*COS (THETA ) -FLOAT (MNY) *SIN( THETA) ) 

C—  ESTABLISH  THE  X  AND  Y  VARIABLES  — C 

X-FLOAT(MNX) * FLOAT (MNX) 

Y- FLOAT ( MNY ) * FLOAT (MNY) 

C —  GENERATE  THE  GABOR  FUNCTION  BASED  ON  THE  XP,  X,  AND  Y  VARIABLES  — C 

GBR ( RG , CG ) -EXP  < - ( X+ Y ) / ( 2 . * ( FLOAT ( N )/2 . /FREQ ) * 

+  (FLOAT(N)/2./FREQ) ) )* 

+  ( COS ( 2 . *PI *XP* ( FLOAT( N )/2 ./FREQ ) ) )/ 

+  (2.*PI*( ( FLOAT ( N ) /2 . /FREQ ) *  *  2 ) ) 


MNX-MNX+1 

CG-CG+1 

END  DO 

MNY-MNY+1 

RG-RG+I 

END  DO 

C—  SCALE  THE  GABOR  FUNCTION  TO  MAX  EQUAL  255  — C 

DO  C-1,512 
XTOP-O. 

DO  R-1,256 

XT2-GBR(R,C) 

RTOP-XTOP-XT2 
ir(RTOP.LT.O)  THEN 
XTOP-XT2 
END  IF 

END  DO 
TOP ( C ) -XTOP 

END  DO 

THE  MAX-0. 

DO  C-1,512 
XT3-TOP(C) 

RTOP-THE  MAX- XT 3 


I F ( RTOP . LT . 0 )  THEN 

THE_MAX-XT3 

END  IF 


END  DO 

DO  R-1,256 
DO  01,512 

GBR(R, C)-255. * { GBR( R, C )/THE  MAX) 
END  DO 
END  DO 


OR  ELSE  CREATE  THE  SINE  WAVE  SELF  SIMILAR  GABOR  FUNCTION 


ELSE 

DO  I«1,N 

CG-255-N/2 

MNX-N/2-N 

DO  J-1,N 

XP-( FLOAT ( MNX ) *COS( THETA) -FLOAT ( MNY) *S IN ( THETA) ) 
X- FLOAT ( MNX ) * FLOAT ( MNX ) 

Y-FLOAT { MNY ) *  FLOAT ( MNY ) 

GBR ( RG , CG ) “EXP ( - ( X+ Y ) /( 2 . * ( FLOAT ( N ) /2 . /FREQ ) * 

+  (FL0AT(N)/2./FREQ) ) )* 

+  (SIN(2.*PI*XP/(FLOAT(N)/2./FREQ) ) )/ 

+  ( 2 . *PI * ( ( FLOAT ( N ) /2 . /FREQ ) *  * 2 ) ) 

MNX-MNX+1 

CG-CG+1 

END  DO 

MNY-MNY+1 

RG-RG+1 

END  DO 

DO  01,512 
XTOP-0. 

DO  R-1,256 

XT2-GBR(R,C) 

RT0P-XT0P-XT2 
IF(RTOP.LT.O)  THEN 
XT0P-XT2 
END  IF 

END  DO 
TOP( C ) -XTOP 

END  DO 

THE  MAX-0. 

DO  £-1,512 
XT3-T0P(C) 

RTOP-THE  MAX-XT3 


IF(RTOP.LT.O)  THEN 

THE_MAX-XT3 

END  IF 


END  DO 

DO  R-1,256 
DO  01,512 

GBR(R, C)-255. * { GBR( R , C )/THE_MAX ) 
END  DO 
END  DO 

END  IF 

RETURN 

END 


SUBROUTINE  MSS  GABOR ( GBR , N , M , Ml , NROT , NSC ) 


INTEGER 

DIMENSION 

DIMENSION 

COMPLEX 


R , C , RG , CG , RGPN , CGPN 
NGBR( 256,512) ,GBR( 256 , 512 ) 
TOP ( 512 ) 

CMPLX , CNUM 


C —  ESTABLISH  CONSTANTS  AND  PARAMETERS  — C 

PI-3.141592654 

FREQ-FLOAT ( M ) 

ANGLE- FLOAT (NROT) 

CYCLES-FLOAT(Ml) 

C —  ESTABLISH  THE  CENTERING  OF  THE  GABOR  FUNCTION 

RG-127-N/2 

RGPN-RG+N 

CG-255-N/2 

CGPN-CG+N 


C —  ZERO  OUT  THE  GBR  TRANSFER  DATA  STRUCTURE  — C 


DO  R-1,256 

DO  C-1,512 
GBR ( R , C ) -0 
END  DO 
END  DO 


C-- 


CONVERT  FROM  DEGREES  TO  RADIANS  — C 


THETA-ANGLE*PI/180 . 


RG-127-N/2 

MNY-N/2-N 


C—  CHOOSE  BETWEEN  COSINE  OR  SINE  WAVE  SELF  SIMILAR  GABOR  FUNCITON  — C 
IF(NSC.EQ.l)  THEN 


C —  BEGIN  GENERATING  THE  COSINE  GABOR  FUNCTION  — C 

DO  I-1,N 

CG-255-N/2 

MNX-N/2-N 

DO  J-1,N 

C —  ESTABLISH  THE  ROTATION  VARIABLE  XP  — C 

XP- ( FLOAT ( MNX ) *  COS { THETA ) - FLOAT ( MNY ) *  S IN ( THETA )  ) 

C —  ESTABLISH  THE  X  AND  Y  VARIABLES  — C 

X- FLOAT ( MNX ) *  FLOAT ( MNX ) 

Y- FLOAT ( MNY ) *  FLOAT ( MNY ) 

C—  GENERATE  THE  GABOR  FUNCTION  BASED  ON  THE  XP,  X,  AND  Y  VARIABLES  — C 

GBR ( RG , CG ) -EXP ( - ( X+Y ) / ( 2 . * ( FLOAT (N)/2 . /FREQ ) * 

+  (FLOAT(N)/2./FREQ) ) )* 

+  (COS(2.*PI**CYCLES*XP*(FLOAT(N)/2./FREQ) ) )/ 

+  ( 2 . *CYCLES*PI* ( { FLOAT ( N ) /2 . /FREQ ) *  *  2 ) ) 


MNX-MNX+1 

CG-CG+1 

END  DO 

MNY-MNY+1 

RG-RG+1 

END  DO 

C—  SCALE  THE  GABOR  FUNCTION  TO  MAX  EQUAL  255  — C 

DO  C-1,512 
XTOP-O . 

DO  R-1,256 

XT2-GBR( R, c ) 

RTOP-XTOP-XT2 
IF(RTOP.LT.O)  THEN 
XTOP-XT2 
END  IF 


END  DO 
TOP(C)-XTOP 


END  DO 

THE_MAX-0 . 

DO  C-1,512 
XT3-TOP(C) 

RTOP-THE_MAX-XT3 
IF(RTOP.LT.O)  THEN 
THE_MAX-XT3 
END  IF 

END  DO 

DO  R-1,256 
DO  C-1,512 

GBR (R, C)-255. *(GBR(R,C)/THE_MAX) 
END  DO 

END  DO 


OR  ELSE  CREATE  THE  SINE  WAVE  SELF  SIMILAR  GABOR  FUNCTION 


ELSE 

DO  1-1 , N 

CG-255-N/2 

MNX-N/2-N 

DO  J-l , N 

XP- ( FLOAT ( MNX ) *  COS (THETA ) - FLOAT ( MN Y ) *  S I N ( THETA ) ) 
X- FLOAT ( MNX ) *  FLOAT ( MNX ) 

Y-FLOAT ( MNY ) *  FLOAT ( MNY ) 

GBR(RG,CG)-EXP(-(X+Y)/(2.*(FLOAT(N)/2./FREQ)* 

+  ( FLOAT ( N ) /2 . /FREQ ) ) ) * 

+  ( SIN( 2 . *PI **CYCLES*XP/( FLOAT ( N )/2 . /FREQ ) ) )/ 

+  (  2 . *PI*CYCLES* ( ( FL0AT(N)/2 ./FREQ) **2 ) ) 

MNX-MNX+1 

CG-CG+1 

END  DO 

MNY-MNY-fl 

RG-RG+1 

END  DO 

DO  C-1,512 
XTOP-0 . 

DO  R-1,256 

XT2-GBR(R,C) 

RT0P-XT0P-XT2 
IF(RTOP.LT.O)  THEN 
XT0P-XT2 
END  IF 


END  DO 
TOP ( C ) -XTOP 

END  DO 

THE_MAX-0 . 

DO  C-1,512 
XT3-TOP(C) 

RTOP-THE_MAX-XT3 
I F ( RTOP . LT . 0 )  THEN 
THE_MAX-XT3 
END  IF 

END  DO 

DO  R-l  256 
DO  C-1,512 

GBR( R, C ) -255 . * ( GBR( R, C ) /THE  MAX) 
END  DO 

END  DO 

ENDIF 

RETURN 

END 


SUBROUTINE  NSSGABOR ( GBR ,N,M, NROT , NSC ) 


INTEGER 

DIMENSION 

DIMENSION 

COMPLEX 


R , C , RG , CG , RGPN , CGPN 
NGBR( 256,512) , GBR( 256,512) 
TOP( 512 ) 

CMPLX, CNUM 


C—  ESTABLISH  CONSTANTS  AND  PARAMETERS 


PI-3.141592654 


FREQ-FLOAT(M) 

ANGLE-FLOAT ( NROT ) 

C —  ESTABLISH  CENTERING  OF  GABOR  FUNCTION 

RG-127-N/2 

RGPN-RG+N 

CG-255-N/2 

CGPN-CG+N 


C-  ZERO  OUT  THE  TRANSFER  DATA  STRUCTURE(S) 


c— 


— c 


DO  R-1,256 

DO  01,512 

GBR (  R ,  C  )  -  (  0  . ,0.  ) 
END  DO 
END  DO 


CONVERT  FROM  DEGREES  TO  RADIANS 

THETA-ANGLE*PI/180 . 

RG-127-N/2 

MNY-N/2-N 


C —  CHOOSE  BETWEEN  SINE  OR  COSINE  WAVE  GABOR  FUNCTION  — C 

IF(NSC.EQ.l)  THEN 


C —  BEGIN  COSINE  GABOR  FUNCTION  GENERATION  — C 

DO  I«1,N 

CG-255-N/2 

MNX-N/2-N 

DO  J-1,N 

XP- ( FLOAT ( MNX ) *COS ( THETA ) - FLOAT { MNY ) *  S IN ( THETA ) ) 

X- FLOAT ( MNX ) *  FLOAT ( MNX ) 

Y- FLOAT ( MNY ) *  FLOAT ( MNY ) 

GBR( RG, CG ) -EXP( -( X+Y)/( 2 . * ( FLOAT ( N )/8 . )*( FLOAT ( N ) /8 . ) ) )* 
+  COS ( 2 . *PI *FREQ*XP )/( 2 . *PI * ( { FLOAT ( N )/8 . ) **2) ) 

MNX-MNX+1 
CG-CG+1 
END  DO 
MNY-MNY+1 
RG-RG+1 
END  DO 


C—  SCALE  THE  GABOR  FUNCTION  MAXIMUM  TO  EQUAL  255  — C 

DO  C-1,512 
XTOP-O . 

DO  R-1,256 

XT2-GBR( R, C ) 

RT0P-XT0P-XT2 
IF(RTOP.LT.O)  THEN 
XT0P-XT2 
END  IF 

END  DO 
TOP( C ) -XTOP 

END  DO 

THE  MAX-0. 

DO  £-1,512 
XT3-T0P(C) 

RTOP-THE  MAX- XT 3 


IF(RTOP.LT.O)  THEN 

THE_MAX-XT3 

END  IF 

END  DO 

DO  R-1,256 
DO  01,512 

GBR(R, C)-255. * ( GBR( R , C )/THE  MAX) 
END  DO 
END  DO 


C —  OR  ELSE  GENERATE  THE  SINE  WAVE  GABOR  FUNCTION  — C 


ELSE 

DO  I-1,N 

CG-255-N/2 

MNX-N/2-N 

DO  J-1,N 

XP- ( FLOAT ( MNX ) *COS ( THETA ) - FLOAT ( MNY ) *  S IN ( THETA ) ) 

X- FLOAT ( MNX ) *  FLOAT ( MNX ) 

Y-FLOAT ( MNY ) *  FLOAT ( MNY ) 

GBR ( RG , CG ) -EXP ( - ( X+ Y )  /  (  2  .  *  ( FLOAT ( N ) /8 . ) * ( FLOAT ( N )/8 . ) ) )* 
+  S IN ( 2 . *PI *FREQ*XP )/{ 2 . *PI * ( (FL0AT(N)/8. )**2) ) 

MNX-MNX+1 
CG-CG+1 
END  DO 
MNY-MNY+1 
RG-RG+1 
END  DO 

DO  Ol  ,512 
XTOP-O . 

DO  R-1,256 

XT2-GBR(R,C) 

RT0P-XT0P-XT2 
IF(RTOP.LT.O)  THEN 
XT0P-XT2 
END  IF 

END  DO 
TOP ( C ) -XTOP 

END  DO 

THE  MAX-0. 

DO  £-1,512 
XT3-T0P(C) 

RT0P-THEMAX-XT3 
IF(RTOP.LT.O)  THEN 
THE_MAX-XT3 
END  IF 

END  DO 


DO  R-1,256 
DO  01,512 

GBR ( R , C)-255. * ( GBR ( R , C ) /THE_MAX ) 
END  DO 
END  DO 


ENDIF 

RETURN 

END 


SUBROUTINE  GABOR_TRANSFORM ( GBR , NAR , NMAG , NR_NUM , NC_NUM , npnum ) 


DIMENSION 

DIMENSION 

COMPLEX 

COMPLEX 

INTEGER 


NMAG (256, 51 2) ,NAR( 256 , 512 ) 

GBR( 256,512) ,TOP( 512 ) ,XMAG( 256,512) 
U , CAR (256,512) , CGBR( 256 , 512 ) 

CC( 512 ) ,G( 512 ) ,  V 
R , C , RP , CP , RMl 


type*, 'Begin  gabor  transform  pass', np_num 


C—  ZERO  OUT  THE  TRANSFER  VARIABLES  AND  DATA  STRUCTURES  — C 

type* ,' Zeroing  out  the  transfer  arrays' 

DO  R-1,256 
DO  01,512 

CC(C)-(0. ,0. ) 

G(C)-(0. ,0. ) 

CAR( R , C ) - ( 0 . ,0. ) 

CGBR ( R , C ) » ( 0 . ,0. ) 

NMAG (R, C)-0 
TOP ( C ) -0 . 

END  DO 
END  DO 


RP-9 
SUM-0 . 

MFLG-1 

U- ( 1 . 0 , 0 . 0  ) 
V«(1.0,0.0) 


c— 


CONVERT  DATA  FROM  INTEGER  TO  COMPLEX  FORMAT  — C 
type* , 'Converting  the  data  to  complex  format' 


o  o 


DO  R-1,256 

DO  01,512 

CAR(R,C)-NAR(R,C)*U 
CGBR ( R , C ) -GBR( R , C ) *U 

C—  COLUMN  VECTORIZING  OF  DATA  — C 

CC ( C ) “CAR ( R , C ) 

G(C)-CGBR(R,C) 

END  DO 

C —  SEND  DATA  TO  FAST  FOURIER  TRANSFORM  SUBROUTINE  —C 

CALL  FFT(CC,9,MFLG) 

CALL  FFT{ G, 9 ,MFLG) 

C —  PUT  THE  VECTORS  BACK  INTO  MATRIX  FORMAT  — C 

DO  01,512 

CAR(R,C)-CC(C) 

CGBR(R,C)-G(C) 

END  DO 
END  DO 


C —  ZERO  OUT  THE  TRANSFER  STRUCTURES  — C 

DO  01,512 

CC(C)-(0. ,0. ) 

G(  C ) - ( 0 . ,0.  ) 

END  DO 

C~  ROW  VECTORIZE  THE  COLUMN  FFT'd  DATA  — C 

DO  01,512 
DO  R-1,256 

CC ( R ) -CAR ( R , C ) 

G ( R ) -CGBR ( R , C ) 

END  DO 

C—  SEND  DATA  TO  FFT  SUBROUTINE  — C 

CALL  FFT( CC , 8 , MFLG) 

CALL  FFT (G, 8, MFLG) 

DO  R-1,256 

C—  CONVERT  VECTORS  BACK  TO  MATRIX  FORMAT  — C 

CAR ( R , C ) -CC ( R ) 

CGBR ( R , C ) -G ( R ) 

END  DO 


END  DO 


C—  COMPLETED  THE  TWO  DIMENSIONAL  FFT  OF  IMAGE  AND  GABOR  FUNCTION 

—  PERFORM  POINT  FOR  POINT  MULTIPLICATION  OF  THE  — 

—  FFT  IMAGE  WITH  THE  COMPLEX  CONJUGATE  OF  THE 


o  o 


C-- 


FFT  GABOR  FUNCTION. 


—  C 


DO  R-1,256 
DO  C-1,512 

CAR ( R , C ) -CAR ( R , C ) *CON JG ( CGBR (  R  ,  C  ) ) 
END  DO 
END  DO 


C —  BEGIN  INVERSE  FFT  OF  CORRELATION  — C 

DO  R-1,256 
DO  C-1,512 

C —  COLUMN  VECTORIZE  THE  CORRELATION  IMAGE  — C 
CC ( C ) -CAR( R , C ) 

END  DO 

C —  SEND  VECTOR(S)  TO  INVERSE  FFT  ROUTINE  — C 
CALL  FFT( CC , 9 , MFLG ) 

C —  PUT  VECTORS  BACK  INTO  MATRIX  FORMAT  — C 

DO  C-1,512 

CAR ( R , C ) -CC ( C ) 

END  DO 

END  DO 

C—  ZERO  OUT  THE  TRANSFER  DATA  STRUCTURE  — C 

DO  C-1,512 

CC(C)-(0.  ,0.  ) 

END  DO 

C—  ROW  VECTORIZE  THE  COLUMN  FFT'd  DATA  — C 

DO  C-1,512 
DO  R-1,256 

CC ( R ) -CAR ( R , C ) 

END  DO 

C —  SEND  VECTOR ( S )  TO  INVERSE  rPT  ROUTINE  — C 
CALL  FFT( CC, 8 ,MFLG) 

C—  PUT  VECTOR ( S )  BACK  INTO  MATRIX  FORMAT  — C 

DO  R-1,256 

CAR(R,C)-CC(R) 

END  DO 

END  DO 

C —  INVERSE  FFT  OPERATION  IS  A  FORWARD  FFT  OPERATION  WITH  — C 
C —  THE  CONJUGATE  OF  THE  RESULTANT  IMAGE  MULTIPLIED  BY  THE  — C 
C—  DIMENSIONS  OF  THE  IMAGE  (X  BY  Y).  — C 


DO  R-1,256 
DO  01,512 

CAR  (R, 0-256*512*  CON  JG  {  CAR  (  R ,  C  )  ) 

C —  CONVERT  THE  IMAGE  INTO  A  MAGNITUDE  SQUARED,  OR  INTENSITY 
XMAG ( R , C ) -CABS { CAR ( R , C ) ) *CABS ( CAR ( R , C ) ) 

END  DO 
END  DO 


C—  SCALE  THE  ENTIRE  IMAGE  TO  MAX  EQUAL  255  — C 

DO  C-1,512 
XTOP-0 . 

DO  R-1,256 

XT2-XMAG{ R, C ) 

RT0P-XT0P-XT2 
IF(RTOP.LT.O)  THEN 
XT0P-XT2 
END  IF 

END  DO 
TOP ( C ) -XTOP 

END  DO 

THE_MAX-0. 

DO  C-1,512 
XT3-T0P  (  C ) 

RT0P-THE_MAX-XT3 
IF(RTOP.LT.O)  THEN 
THEMAX-XT3 
END  IF 
END  DO 
DO  R-1,256 
DO  C-1,512 

XMAG(R, 0-255.  *(XMAG(R,C)/THE  MAX) 
NMAG(R,C)-IFIX(XMAG(R,C) ) 

END  DO 
END  DO 


C—  BEGIN  ROTATION  OF  IMAGE  ABOUT  THE  X  AND  Y  AXES  — C 

DO  R-1,128 
RP-R+128 
DO  C-1,256 
CP-C+256 

NTEMPl-NMAG ( R , C ) 

NMAG ( R , C ) -NMAG( RP , CP ) 

NMAG( RP , CP ) -NTEMP1 
NTEMP2-NMAG( R, CP ) 

NMAG ( R , CP ) -NMAG ( RP , C ) 

NMAG(RP,C)-NTEMP2 
END  DO 
END  DO 


DO  R-1,128 
NR-257-R 
DO  C-1,512 

NTEMPl -NMAG (  R ,  C  ) 

NMAG (  R ,  C  ) -NMAG ( NR , C ) 

NMAG ( NR , C ) -NTEMPl 
END  DO 
END  DO 
DO  C-1,256 
NC-513-C 
DO  R-1,256 

NTEMPl-NMAG(R,C) 

NMAG (  R ,  C  ) -NMAG { R , NC ) 

NMAG(R,NC) -NTEMPl 
END  DO 
END  DO 

C —  ROTATION  COMPLETED  — C 

type* completed  gabor  transform  pass', np_num 

RETURN 

END 


SUBROUTINE  PUT_FLIR_IM( NAMEOUT , NMAG , ROW  NUM,COL  NUM) 


IMPLICIT 

DIMENSION 

BYTE 

CHARACTER* 2 4 


INTEGER (A-Z) 

NMAG( 256,512) 

NMAG  BYTE( 240,640) 
NAMEOUT 


C —  ZERO  OUT  THE  BYTE  FORMAT  TRANSFER  DATA  STRUCTURE  — C 

DO  R-1,240 
DO  C-1,640 

NMAG_B YTE ( R , C ) -0 
END  DO 
END  DO 

C—  PUT  THE  256  BY  512  IMAGE  INTO  A  240  BY  640  FORMAT  — C 


RP-9 

DO  R-1,240 

DO  C-65,576 
CP-C-64 

NMAG_BYTE ( R , C ) -MOD  <  NMAG (RP,CP),256)-128 
END  DO 
RP-RP+1 
END  DO 


OPEN ( 2  0 , F I LE-NAMEOUT , STATUS- ' NEW ' , FORM- ' UNFORMATTED ' 


+  RECL-C0L_NUM/4+l , RECORDTYPE- ' FIXED ' ) 


DO  100  R-l,ROW_NUM 

WRITE ( 20 )  (NMAG_BYTE(R,C) ,C-l,COL  NUM ) 
100  CONTINUE 

C —  ZERO  OUT  THE  DATA  STRUCTURES  — C 


CLOSE( 20 ) 

RETURN 

END 


SUBROUTINE  FFT ( F , LN , MFLG ) 

COMPLEX  F(1024) ,U,W,T,CMPLX 

PI-3.141592654 

N-2**LN 

NV2-N/2 

NM1-N-1 

J-l 

DO  3  I  — 1 , NMl 

IF( I .GE. J)  GO  TO  1 
T-F ( J ) 

F  (  J ) «F ( I ) 

F  (  I ) -T 

1  K-NV2 

2  IF(K.GE.J)  GO  TO  3 

J-J-K 
K-K/2 
GO  TO  2 

3  J-J-rK 
DO  5  L-l , LN 

LE-2  *  *L 
LEl-LE/2 
U-  ( 1 . 0 , 0 . 0  ) 

W-CMPLX ( COS ( PI/LEI ) , -SIN( PI /LEI ) ) 
DO  5  J-l , LEI 

DO  4  I- J , N , LE 
I P-I+LEl 
T-F ( IP)*U 
F (  IP ) -F ( I ) -T 

4  F ( I ) — F ( I ) +T 

5  U-U*W 
DO  6  I— 1 , N 

6  F  (  I ) »F ( I ) /FLOAT ( N ) 

RETURN 

END 


subroutine  help 


continue 


DO  1-1 
TYPE* , 
END  DO 
type* , 
TYPE*, 
TYPE*, 
TYPE*, 


TYPE*, 
TYPE*, 
TYPE* , 
READ( 5 


WELCOME  TO  THE  GABOR  TRANSFORM  HELP  SCREEN ' 

t 


TYPE* , 

'  * 

* ' 

TYPE*, 

'  * 

NAME  OF  FLIR  IMAGE 

- 

1 

* > 

TYPE*, 

1  ★ 

*  • 

TYPE*, 

'  * 

LOWEST  FREQUENCY 

- 

2 

* ' 

TYPE*  , 

'  * 

* » 

TYPE*, 

*  * 

HIGHEST  FREQUENCY 

- 

3 

* 

TYPE* , 

'  * 

■k  ' 

TYPE* , 

'  * 

STANDARD  DEVIATION 

- 

4 

*  ' 

TYPE*, 

'  * 

AT  MAX  EXTENT 

*  > 

TYPE*, 

'  ★ 

* 

TYPE*, 

f  ★ 

MAX  ANGULAR  ROTATION 

- 

5 

■k 

TYPE*, 

'  It 

k 

TYPE*, 

9  * 

I NCR.  OF  ROTATION 

- 

6 

k 

TYPE*, 

9  it 

k 

TYPE*, 

•  it 

SIZE  OF  GABOR  WINDOW 

- 

7 

k 

TYPE*, 

9  ★ 

k 

TYPE*, 

'  * 

REGULAR  SELF  SIMILAR 

- 

8 

k 

TYPE* , 

9  * 

MODIFIED  SELF  SIMILAR 

- 

9 

k 

TYPE* , 

9  it 

NON-SELF  SIMILAR 

- 

10 

k 

TYPE*, 

9  it 

k 

TYPE*, 

9  it 

SEGMENTATION 

- 

11 

k 

TYPE*, 

9  it 

CLASSIFICATION 

- 

12 

k 

TYPE*, 

9  * 

k 

TYPE*, 

9  * 

SINE 

- 

13 

k 

TYPE* , 

9  it 

COSINE 

- 

14 

k 

TYPE*, 

9  * 

k 

TYPE*, 

'  * 

RETURN  TO  MAIN  PROGRAM 

- 

15 

k  ' 

*********************************************' 


TYPE*, 'ENTER  YOUR  CHOICE:  ' 

READ( 5 , * ) NHELP 
I F ( NHELP . EQ . 1 )  THEN 

TYPE*, 'The  name  of  the  FLIR  image  you  wish  to  transform' 
type*, 'is  a  user  specified  name.  The  name  can  be  any' 
type* ,' extension  provided  the  file  the  name  refers  to  is' 
type*, 'of  the  proper  format  (240  by  640,  BYTE).' 
type*,'  ' 

type*, 'To  return  to  the  menu,  enter  a  1' 
read<  5 , *  )n 
goto  1 

ELSEIF(NHELP.EQ.2)  then 


type*, 'The  lowest  frequency  is  the  lower  bound  on  frequencies  ' 
type*, 'the  user  wishes  to  investigate.  the  difference  between  ' 
type*, 'the  highest  and  lowest  frequencies  of  interest  plus  one  ' 
type* ,' establishes  thfe  number  of  frequency  passes  through  the  ' 
type* ,' program.  This  value,  coupled  with  the  number  of  ' 
type* ,' orientations ,  will  determine  the  total  number  of  passes  ' 
type* ,' through  the  program.  ' 
type*,'  ' 
type* , '  ' 
type* , '  ' 

type*, 'To  return  to  the  menu,  enter  a  1' 
read( 5 , * ) n 
goto  1 

ELSEIF(NHELP.EQ.3)  THEN 

type*, 'The  highest  frequency  is  the  highest  number  of  cycles  ' 

type*, 'per  envelope  the  user  wishes  to  investigate.  The  ' 

type* , ' di f f erence  between  the  highest  and  loest  frequencies  ' 

type*, 'plus  one  determines  the  number  of  frequency  passes  ' 

type* ,' through  the  program.  This  value,  coupled  with  the  ' 

type* ,' number  of  orientations  determines  the  total  number  of  ' 

type* , 'passes  through  the  program.  ' 

type* , '  ' 

type* , '  ' 

type* , '  ' 

type* , '  ' 

type*, 'To  return  to  the  menu,  enter  a  1' 
read( 5 , *  )n 
goto  1 

ELSEIF(NHELP.EQ.4)  THEN 

type*, 'The  standard  deviation  at  max  extent  is  the  number  ' 
type*, 'of  standard  deviations  the  user  wishes  to  correspond  ' 
type*, 'to  the  window  size  parameter.  ' 

type*, 'For  example:  If  16  is  chosen  for  window  size,  and  ' 
type*, 'four  is  chosen  for  std.  dev.,  then  four  standard  ' 
type* , 'deviations  will  correspond  to  the  N/2  pixel  from  the  ' 
type* ,' center  of  the  gabor  window.  For  this  example,  the  eighth  ' 
type*, 'pixel  from  the  center  of  the  Gabor  function  will  correspond 
type*, 'to  four  standard  deviations.  ' 
type*,'  ' 

type*, 'To  return  to  the  menu,  enter  a  1' 
read( 5, * )n 
goto  1 

ELSEI F ( NHELP . EQ . 5 )  THEN 

type* , 'Maximum  angular  orientation  corresponds  to  the  maximum  ' 
type* ,' angular  rotation  (in  degrees)  the  user  wishes  to  ' 
type* ,' investigate .  The  maximum  angular  orientation  MUST  be  ' 
type*, 'an  integer  multiple  of  the  increments  of  rotation.  ' 
type* , '  ' 

type*, 'For  example:  If  the  user  wishes  to  investigate  the  ' 
type* ,' processing  characteristics  of  Gabor  functions  from  0  to  ' 
type*, '135  degrees.  The  increment  of  rotation  MUST  divide  into  ' 
type*, '135  evenly.  ' 
type*,'  ' 

type*, 'To  return  to  the  menu,  enter  a  1' 
read( 5, * )n 
goto  1 

ELSEI F( NHELP . EQ . 6 )  THEN 


type  * , 
type* , 
type* , 
type* , 
type*, 
type*, 
type* , 
type* , 
type*, 
type*, 
type* , 
read( 5 
goto  1 


Increment  of  rotation  is  the  change  in  orientation  ' 
relative  to  0  degrees.  The  increment  of  change  MUST 
evenly  divide  into  the  maximum  angular  orientation.  ' 

9 

For  example:  if  Max.  Orient,  equals  135,  then  the  ' 
Incr.  of  Rot.  MUST  be  5,  10,  15,  so  on  up  to,  and  ' 
including  135.  ' 


To  return  to  the  menu,  ente-r  a  1' 
* )  n 


9 


ELSEIF ( NHELP . EQ . 7 )  THEN 

type*, 'Size  of  the  Gabor  window  is  a  parameter  linked  to  ' 

type*, 'the  standard  deviation.  Given  a  std.  dev.,  the  Gabor  ' 

type* , 'window  size  (N)  divided  by  2  ( N/2 )  will  correspond  ' 

type*, 'to  the  std  dev.  ' 

type* , '  ' 

type* , '  ' 

type* , '  ' 

type*,'  ' 

type* ,  '  ' 

type* ,  '  ' 

type*, 'To  return  to  the  menu,  enter  a  1' 
read( 5 , * ) n 
goto  1 

ELSEIF ( NHELP . EQ . 8 )  THEN 

type*, 'The  regular  self  similar  Gabor  function  produces  ' 
type*, 'a  single  cycle  per  envelope  Gabor  function  with  ' 
type*, 'the  specific  orientation  determined  by  the  user.  ' 
type*, 'As  the  function's  spread  becomes  smaller,  the  ' 
type* ,' frequency  increases  to  compensate,  thereby  maintaining' 
type*, 'the  number  of  cycles  constant  under  the  Gaussian' 
type* , ' envelope . ' 

type*, 'The  regular  self  similar  Gabor  function  has  ' 
type* ,' biological  implications  since,  it  is  believed  ' 
type*, 'that  the  brain  possesses  cells  which  respond  in  the  ' 
type*, 'same  fashion  as  Gabor  functions.  ' 
type*,'  ' 
type*,'  ' 

type*, 'To  return  to  the  menu,  enter  a  1' 
read( 5, *  )n 
goto  1 

ELSEI F ( NHELP . EQ . 9 )  THEN 

type* ,' Modified  Gabor  functions  possess  the  dilating  nature  ' 
type*, 'of  the  regular  self  similar  Gabor  function  but  allows  ' 
type*, 'the  user  to  specify  the  number  of  cycles  per  envelope, 
type*,'  ' 

type*, 'This  allows  the  modified  Gabor  function  to  take  on  the 
type* ,' characteristic  of  non-self  similar  Gabor  functions.  ' 
typ«**'The  non-self  similar  Gabor  function  information  may  ' 
type*, 'be  found  under  number  10.  ' 
type*,'  ' 
type*,'  ' 

type*, 'To  return  to  the  menu,  enter  a  1' 
read( 5 , *  )n 


goto  1 


ELSEIF 
type*, 
type* , 
type*, 
type*, 
type*, 
type*, 
type*, 
type*, 
type*, 
type*, 
type* , 
read( 5 
goto  1 


(NHELP.EQ.10)  THEN 

'The  non-self  similar  Gabor  function  allows  the  user  to 
'specify  the  number  of  cycles  per  envelope  but  fixes  the 
'standard  deviation  of  the  Gaussian  cofactor.  ' 


To  return  to  the  menu,  enter  a  1' 
* )  n 


ELSEIF ( NHELP.EQ.il)  THEN 

type* ,' Segmentation  uses,  primarily,  the  non-self  similar  nature  ' 
type*, 'of  the  Gabor  functions  (be  it  explicit  by  using  non-self  ' 
type* ,' similar  Gabor  functions  or  implicit  when  using  the  modified 
type*, 'Gabor  function.  Segmentation  is  the  act  of  separating  an  ' 
type*, 'object  of  interest  from  regions  of  relatively  no  interest.  1 
type*, 'The  regions  of  relatively  no  interest  may  have  significant  1 
type* ,' structure  thereby  cluttering  the  image(s).  ' 


type*, 
type*, 
type*, 
type*, 
type*, 
type*, 
type*, 
type*, 
type*, 
type*, 
read( 5 
goto  1 

ELSEIF( 
type*, ' 
type*, » 
type*, ' 
type*, ' 
type*, ' 
type*, ' 
type*, ' 
type*, ' 
type*, ' 
type*, ' 
type*, ' 
read ( 5 , 
goto  1 

ELSEIF( 

type*, 

type*, 

type*, 

type*, 

type*, 

type*, 

type*, 

type*, 

type*, 

type*, 

type*, 

read( 5 


To  return  to  the  menu,  enter 
*  )n 


NHELP.EQ.12)  THEN 

Classification  is  the  act  of  determining  the  target  ' 
or  object  of  interest  identification  (signature,  response, 
or  shape,  color,  texture,  etc.).  This  program  generates  ' 
the  jet  vector  components  needed  for  classification.  ' 


To  return  to  the  menu,  enter  a  1' 
*  )n 


NHELP.EQ. 13 )  THEN 

Sine  wave  Gabor  functions  primarily  detect  edges. 


To  return  to  the  menu,  enter  a  l1 
*  )n 


Appendix  D.  Multiple  image  superposition  FORTRAN  source  code. 

THRESH_ADD_H I ST . FOR 


SYNOPSIS:  The  THRESH_ADD_HIST. FOR  program  takes  user  defined  images 
and  adds  them  together,  pixel  for  pixel.  The  program  generates  an 
output  file  for  the  superimposed  image  and  prompts  the  user  for 
labeling  or  not  labeling  highest  pixel  value  locations.  After 
superimposing  the  images,  the  program  generates  a  histogram  of  the 
normalized  intensity  distribution  of  the  superimposed  image.  A 
threshold  is  set  based  on  the  normalized  intensity  distribution. 
After  thresholding  the  superimposed  image,  the  pixel  values  above 
the  threshold  level  are  set  to  unity  and  those  below  the  threshold 
are  set  to  zero.  The  program  continues  until  the  user  desires 
termination. 

INPUT:  Images,  240  by  640  pixels. 

OUTPUTS:  Superimposed  Gabor  image(s) 

Threaholded,  binarized  versions  of  superimposed  Gabor 

image(s) . 

Histogram  of  the  normalized  intensity  distribution(s) . 
OPTIONAL:  Locations  of  all  highest  pixel  values. 
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PROGRAM  TO  SUPERIMPOSE  IMAGES,  HISTOGRAM  THE  SUPERIMPOSED  IMAGE 
BASED  ON  INTENSITY,  THEN  THRESHOLD  THE  IMAGE  BASED  ON  THE 
INTENSITY  DISTRIBUTION. 

ARRAYS  USED: 

NAR 
NSUM 

COUNT 
RNAR 
RSUM 
TOP 

VARIABLES  USED: 

NUM 

NLABEL 


XMAX , XT2 , XDI FF , 
XDIFF2,  XTOP 
NLO 
NHI 

NCOUNT 

NCHOICE 

ASCII  VARIABLES  USED: 


NAME  -  NAME  OF  INPUT  FILE(S) 

NAMEOUT  -  NAME  Or  THE  NON-THRESHOLDED  OUTPUT  FILE 

THR  NAME  -  NAME  OF  THE  THRESHOLDED  OUTPUT  FILE 


WRITTEN 

BY: 

KEVIN 

W.  AYER, 

CAPT, 

USAF 

DATE: 

15 

JUL 

89 

UPDATED 

BY: 

KEVIN 

W.  AYER, 

CAPT, 

USAF 

DATE: 

31 

JUL 

89 

UPDATED 

BY: 

DATE: 

PROGRAM  MAINADD 

DIMENSION  NAR (240,640) , NSUM (240,640), COUNT ( 53) 
DIMENSION  RNAR (240,640), RSUM (240,640), TOP (640) 
CHARACTER* 2 4  NAME , NAMEOUT , THR  NAME 


-  NUMBER  OF  FLIR  IMAGES  TO  ADD 

-  LABEL  TOGGLE,  IF  NLABEL-1,  THEN  LABEL 
ALL  PIXELS  PASSING  A  CERTAIN  THRESHOLD 
(LOCATIONS) 

-  USED  FOR  THE  PURPOSES  OF  FINDING  THE 
MAXIMUM  PIXEL  VALUE  FOR  SCALING 

-  LOWER  THRESHOLD  LEVEL 

-  UPPER  THRESHOLD  LEVEL 

-  TOTAL  NUMBER  OF  LABELED  PIXELS 

-  REPEAT  THE  PROCESS  INDICATOR 


-  INTEGER  FORMAT  OF  THE  INPUT  IMAGE 

-  INTEGER  FORMAT  OF  THE  SUPERIMPOSED 
IMAGES 

-  NOT  USED 

-  REAL  FORMAT  OF  INPUT  IMAGE 

-  REAL  FORMAT  OF  THE  SUPERIMPOSED  IMAGES 

-  MAXIMUM  PIXEL  VALUES  PER  COLUMN 


1 


CONTINUE 


T?PE* , ' HOW  MANY  FLIR  IMAGES  DO  YOU  WISH  TO  SUM?' 

READ( 5, * )NUM 

TYPE*, 'WHAT  DO  YOU  WISH  TO  CALL  THE  SUPERIMPOSED  IMAGE  PILE?' 
ACCEPT  4 0 , NAMEOUT  file? 

TYPE*, 'DO  YOU  WISH  TO  LABEL  TO  HIGHEST  PIXELS?  NO-0.  YES-1' 
READ{ 5, * )NLABEL 

TYPE*, 'ZEROING  OUT  THE  TRANSFER  ARRAYS' 

DO  1-1,240 
DO  J-1,640 

NSUM ( I , J ) -0 
RSUM( I, J)-0. 

END  DO 
END  DO 

TYPE* ,' BEGINNING  THE  SUMMING  ROUTINE' 

DO  45  L-l , NUM 

TYPE*, 'NAME  OF  FLIR  IMAGE  ',L,'  ?' 

ACCEPT  40, NAME 

CALL  GET_FLIR__IM( NAME , NAR ,240,640) 

DO  1-1,240 
DO  J-1,640 

NSUM ( I , J ) -NSUM ( I , J ) +NAR ( I , J ) 

RSUM( I, J) -FLOAT (NSUM ( I , J ) ) 

END  DO 
END  DO 


45  CONTINUE 

TYPE*, 'SUMMING  ROUTINE  COMPLETED' 

TYPE*,'  ' 

TYPE*, 'FINDING  THE  MAX  VALUE  AND  SCALING  TO  THIS  VALUE' 
DO  1-1,240 
XMAX-0 . 

DO  J-17,528 

XT2-RSUM( I, J) 

XDIFF— XMAX-XT2 
IF(XDIFF.LT.O)  THEN 
XMAX-XT2 
ENDIF 
END  DO 
TOP ( I ) -XMAX 
END  DO 
XTOP-0 . 

DO  1-1,240 
XT3-TOP( I ) 

XDI FF2-XTO?- YT2 
IF( XDIFF2 . LT . 0 )  THEN 
XTOP-XT3 

END  IF 
END  DO 
DO  1-1,240 
DO  J-1,640 

RSUM ( I , J ) -RSUM ( I , J ) *  2  5  5 . /XTOP 
NSUM ( I,J)-IFIX( RSUM( I , J ) ) 


END  DO 
END  DO 

OPEN ( 31 , FILE-' LINES . DAT ' , STATUS- 'NEW' , FORM- ' FORMATTED ' ) 
WRITE( 31,131) 

131  FORMAT ( IX, 'COL  200', 5X, 'COL  400') 

DO  1-1,240 

WRITE ( 31 , * )NSUM( 1,200) ,NSUM(I,400) 

END  DO 

WRITE ( 31,132) 

DO  J-1,640 

WRITE ( 31 , * }NSUM(92, J) ,NSUM( 176 , J) 

END  DO 

132  FORMAT(lX, 'ROW  92',5X,'ROW  176') 

CLOSE( 31 ) 

TYPE*, 'SCALING  COMPLETED' 

TYPE*,'  ' 

TYPE*,'  ' 

TYPE*, 'BEGIN  HISTOGRAM' 

CALL  I_HIST( NSUM,NLO , NHI , NLOB , NHIB ) 

TYPE*, 'HISTOGRAM  COMPLETED' 

CALL  PUT_FLIR_IM ( NAMEOUT , NSUM ,240,640) 

TYPE*, 'THRESHOLDING  IMAGE  BASED  ON  HISTOGRAM' 

NLO-NLO-1. 

NHI— NHI+1 . 

IF(NLO.LT.O)  THEN 
NLO-O 
END  IF 

IF ( NHI . GT .255)  THEN 
NHI-255 
END  IF 


TYPE*, 'LOWER  THRESHOLD  -  ',NLO,'BIN  #',NLOB 
TYPE*, 'UPPER  THRESHOLD  -  ', NHI, 'BIN  #',NHIB 

DO  1-1,240 
DO  J-1,640 

I F ( NSUM ( I , J ) . GT .255)  THEN 
NSUM( I , J ) -255 
END  IF 

IF( NSUM( I , J ) . LT. NHI .AND .NSUM ( I , J ) . GT . NLO )  THEN 
NSUM( I , J ) -128 


ELSE 

NSUM( I , J ) -127 

END  IF 
END  DO 

END  DO 

TYPE*, 'THRESHOLDING  COMPLETED' 
TYPE*,'  ' 

TYPE*,'  ' 


fX&E* , ' WHAT  DO  YOU  WISH  TO  CALL  THE  THRESHOLDED 
TYPE* , 'VERSION  OF  THE  SUPERIMPOSED  IMAGE?' 
ACCEPT  40 , THR  NAME 


I F ( NLABEL . EQ . 1 )  THEN 

TYPE*, 'LABELING  THE  HIGH  PIXELS  FOR  THEIR  LOCATION' 
OPEN ( 42 , FILE* ' LAB_FLR_PIX . DAT ' , STATUS- ' NEW ' , 

+  FORM- ' FORMATTED ' ) 

WRITE ( 42,141) THR_NAME 
NCOUNT-1 
DO  1-1,240 

DO  J-65,576 

IF(NSUM( I, J) .EQ.127)  THEN 
WRITE(42, 142)1, J 
END  IF 

NCOUNT-NCOUNT+1 
END  DO 

NCOUNT-NCOUNT+1 
END  DO 

WRI TE ( 4  2 , 1 4  3 ) NCOUNT 

END  IF 

141  FORMAT ( IX, 'FILENAME:  ' ,A24 ,//, IX, '  ROW', 

+  5X, 'COLUMN') 

142  FORMAT ( IX , I 5 , 5X , I 5 ) 

143  F0RMAT(1X,//,1X, 'TOTAL  NUMBER  Or  PIXELS:  ',110) 
CLOSE ( 42) 

TYPE* ,' LABELING  COMPLETED' 

TYPE*, 'STORING  THRESHOLDED  VERSION  OF  ' , NAMEOUT 
CALL  PUT  FLIR  IM( THR  NAME, NSUM, 240 , 640 ) 


TYPE*, 'DO  YOU  WISH  TO  ADD  OTHER  IMAGES  TOGETHER?' 
TYPE*,'  NO-0,  YES-1' 

READ( 5 , * )NCHOICE 
I F ( NCHOICE . EQ . 1 )  THEN 
GOTO  1 
ELSE 
ENDir 


40  FORMAT (A2 4 ) 

50  FORMAT (A3) 

END 


onnoonnoonnoooooooonooonoooonoonon 


C 


SUBROUTINE  TO  HISTOGRAM  THE  SUPERIMPOSED  IMAGE 
ARRAYS  USED: 


NAR 

HIST 

RLHIST 


INTEGER  FORMAT  OF  INPUT  FILE 
HISTOGRAM  VALUES 

LOGARITHM  OF  THE  HISTOGRAM  VALUES 


VARIABLES  USED: 


NCT* 

TOP,DIFFl,DIFF2 

DI FF3 , DI FF4 

DIFF5 

NLO , NLOB 

NHI , NHI3 

NLOJ 


BIN  TOTAL  COUNTERS 

VARIABLES  ASSOCIATED  WITH  FINDING  THE 
HIGH  AND  LOW  THRESHOLD  BOUNDS 

LOWER  THRESHOLD  LEVEL 

UPPER  THRESHOLD  LEVEL 

LOWER  THRESHOLD  LEVEL  WHEN  THE  MAX 

BIN  COUNT  IS  NOT  THE  LOWER  THRESHOLD  LEVEL 


ASCII  VARIABLES  USED: 


NAME IN 
MATRIX 

LOGMAT 


NAME  OF  THE  INPUT  FILE 

NAME  OF  THE  NON-LOGARITHM  HISTOGRAM 

FILE  FOR  MATRIX-X  OUTPUT 

NAME  OF  THE  LOGARITHM  HISTOGRAM  FILE 

FOR  MATRIX-X  OUTPUT 


WRITTEN  BY:  KEVIN  W.  AYER,  CAPT,  USAF  DATE:  15  JUL  89 

UPDATED  BY :  DATE : 


C 


SUBROUTINE  I_HIST( NAR, NLO , NHI , NLOB , NHIB ) 

DIMENSION  NAR (240,640) 

DIMENSION  RLHIST( 53,1 ) ,HIST( 53,1) 

INTEGER  R,C 

CHARACTER* 2 4  NAMEIN, MATRIX, LOGMAT 

1  CONTINUE 

DUMMY- 0 . 

TYPE*,'  ' 

TYPE*, 'THRESHOLD  FOR  COUNT  LEVEL?' 

READ( 5 , * ) TOPI 

TYPE*, 'FOR  MATRIX-X  LINEAR  OUTPUT,  GIVE  FILENAME?' 
ACCEPT  40, MATRIX 

TYPE*, 'FOR  MATRIX-X  LOGARITHMIC  OUTPUT,  GIVE  FILENAME?' 
ACCEPT  40, LOGMAT 
FORMAT (A2 4 ) 

DO  1-1,53 

HIST{ I , 1 )-0 . 

END  DO 


40 


NCTO-O 

NCT1-0 

NCT2-0 

NCT3-0 

NCT4-0 

NCT5-0 

NCT6-0 

NCT7-0 

NCT8-0 

NCT9-0 

NCT10-0 

NCT11-0 

NCT12-0 

NCT13-0 

NCT14-0 

NCT15-0 

NCT16-0 

NCT17-0 

NCT18-0 

NCT19-0 

NCT20-0 

NCT21-0 

NCT22-0 

NCT23-0 

NCT24-0 

NCT25-0 

NCT26-0 

NCT27-0 

NCT28-0 

NCT29-0 

NCT30-0 

NCT31-0 

NCT32-0 

NCT33-0 

NCT34-0 

NCT35-0 

NCT36-0 

NCT37-0 

NCT38-0 

NCT39-0 

NCT40-0 

NCT41-0 

NCT42-0 

NCT43-0 

NCT44-0 

NCT45-0 

NCT46-0 

NCT47-0 

NCT48-0 

NCT49-0 

NCT50-0 

NCT51-0 

NCT52-0 


00  R-1,240 
DO  01,640 

I F ( NAR ( R , C ) . EQ . 0 )  THEN 
NCTO-NCTO+1 


ELSt-I  F  (  NAR(  R ,  C  )  .  GE  .  1  .  AND  .  NAR (  R ,  C  )  .  LT  .  5  )  THEN 
NCT1-NCT1+1 

ELSEI F ( NAR (  R  ,  C  ) . GE . 5 . AND . NAR ( R , C ) . LT.10)  THEN 
NCT2-NCT2+1 

ELSEI F ( NAR (R,C) . GE . 1 0 . AND . NAR ( R , C ) .LT.15)  THEN 
NCT3-NCT3+1 

ELSEI F(NAR(R,C) . GE . 1 5 . AND . NAR ( R , C ) .LT.20)  THEN 
NCT4-NCT4+1 

ELSEI F(NAR(R,C) . GE . 20 . AND . NAR( R , C ) .LT.25)  THEN 
NCT5-NCT5+1 

ELSEI F ( NAR( R , C ) . GE . 25 .AND . NAR( R , C ) . LT . 30 )  THEN 
NCT6-NCT6+1 

ELSEI F( NAR ( R,C) . GE . 30 . AND . NAR ( R , C ) .LT.35)  THEN 
NCT7-NCT7+1 

ELSEI F( NAR( R, C ) .GE . 35 .AND . NAR( R, C ) . LT . 40 )  THEN 
NCT8-NCT8+1 

ELSEI F(NAR(R,C) . GE . 4 0 . AND . NAR ( R , C ) .LT.45)  THEN 
NCT9-NCT9+1 

ELSEI F(NAR(R,C) . GE . 4 5 . AND . NAR ( R , C ) .LT.50)  THEN 
NCTlO-NCTlO+1 

ELSEI F ( NAR( R , C ) . GE . 50 . AND . NAR ( R , C ) .LT.55)  THEN 
NCT11-NCT11+1 

ELSEI F(NAR(R/C) . GE . 5 5 . AND . NAR ( R , C ) .LT.60)  THEN 
NCT12-NCT12+1 

ELSEI F( NAR (R,C) . GE . 60 . AND . NAR ( R , C ) .LT.65)  THEN 
NCT13-NCT13+1 

ELSEI F ( NAR (R,C) . GE . 6 5 . AND . NAR ( R , C ) .LT.70)  THEN 
NCT14-NCT14+1 

ELSEI F ( NAR (R,C) . GE . 70 . AND . NAR ( R , C ) .LT.75)  THEN 
NCT15-NCT15+1 

ELSEI F(NAR(R,C) . GE . 7 5 . AND . NAR ( R , C ) .LT.80)  THEN 
NCT16-NCT16+1 

ELSEI F ( NAR ( R , C ) .GE. 80 .AND.NAR( R, C ) .LT.85)  THEN 
NCT17-NCT17+1 

ELSEI F(NAR(R,C) . GE . 85 . AND . NAR ( R , C ) .LT.90)  THEN 
NCT18-NCT18+1 

ELSEI F ( NAR( R, C ) . GE . 90 . AND . NAR( R , C ) .LT.95)  THEN 
NCT19-NCT19+1 

ELSEI F(NAR(R,C) . GE . 95 . AND . NAR( R , C ) .LT.100)  THEN 
NCT20-NCT20+1 

ELSEI F ( NAR ( R,  C ) . GE . 100 . AND . NAR ( R , C ) .LT.105)  THEN 
NCT21-NCT21+1 

ELSEI F(NAR(R#C) . GE . 105 . AND . NAR ( R , C ) .LT.110)  THEN 
NCT22-NCT22+1 

ELSEI F ( NAR( R, C ) .GE . 110 . AND . NAR( R, C ) .LT.115)  THEN 
NCT23-NCT23+1 

ELSEI F(NAR(R,C) . GE . 11 5 . AND . NAR( R , C ) .LT.120)  THEN 
NCT24-NCT24+1 

ELSEI F ( NAR( R , C ) .GE.120 . AND . NAR( R , C ) .LT.125)  THEN 
NCT25-NCT25+1 

ELSEI F(NAR(R,C) . GE . 1 25 . AND . NAR( R , C ) .LT.130)  THEN 
NCT26-NCT25+1 

ELSEI F(NAR(R,C) . GE . 1 30 . AND . NAR( R , C ) .LT.135)  THEN 
NCT27-NCT27+1 

ELSEI F ( NAR( R, C ) . GE . 1 3 5 . AND . NAR( R , C ) .LT.140)  THEN 
NCT28-NCT28+1 

ELSEI F(NAR(R,C) . GE . 140 . AND . NAR( R , C ) .LT.145)  THEN 
NCT29-NCT29+1 

ELSEI F( NAR ( R,C) . GE . 1 45 . AND . NAR( R , C ) .LT.150)  THEN 
NCT30-NCT30^ 1 


ELS El F ( NAR ( R , C ) . GE . 150 .AND . NAR ( R, C ) . LT . 1 55 )  THEN 
NCT31-NCT31+1 

ELSEI F ( NAR ( R,  C  ) . GE . 1 55 .AND . NAR ( R, C ) . LT . 160 )  THEN 
NCT32-NCT32+1 

ELSEI F( NAR( R,  C ) . GE . 1 6 0 . AND . NAR ( R , C ) .LT.165)  THEN 
NCT33-NCT33+1 

ELSEI F( NAR( R, C ) .GE . 165 .AND . NAR (  R ,  C ) . LT. 170 )  THEN 
NCT34-NCT34+1 

ELSEI F(NAR(R,C) . GE . 1 7 0 . AND . NAR ( R , C ) .LT.175)  THEN 
NCT35-NCT35+1 

ELSEI F ( NAR( R,C) . GE . 17  5 . AND . NAR( R , C ) . LT . 180 )  THEN 
NCT36-NCT36+1 

ELSEI F ( NAR( R , C ) . GE . 1 80 .AND . NAR (R,C).LT.185)  THEN 
NCT37-NCT37+1 

ELSE I F ( NAR ( R , C ) . GE .185. AND . NAR (  R ,  C  ) .LT.19Q)  ^HEN 
NCT38-NCT38+1 

ELSE I F ( NAR (R,C) .GE.190. AND . NAR (  R ,  C  ) .LT.195)  THEN 
NCT39-NCT39+1 

ELSEI F(NAR(R,C) . GE . 1 9 5 . AND . NAR ( R , C ) .LT.200)  THEN 
NCT40-NCT40+1 

ELSEI F ( NAR (R,C) . GE . 2 0 0 . AND . NAR ( R , C ) .LT.205)  THEN 
NCT41-NCT41+1 

ELSEI F ( NAR( R , C ) . GE . 20  5 .AND . NAR ( R , C ) . LT . 210 )  THEN 
NCT42-NCT42+1 

ELSEI F( NAR (R,C) . GE . 21 0 . AND . NAR ( R , C ) . LT.215)  THEN 
NCT43-NCT43+1 

ELSEI F ( NAR( R , C ) . GE . 215 .AND . NAR( R , C ) . LT . 220 )  THEN 
NCT44-NCT44+1 

ELSEI F ( NAR( R,  C ) . GE . 220 .AND . NAR( R,C).LT.225)  THEN 
NCT45-NCT45+1 

ELSEI F ( NAR (R,C} . GE . 22 5 . AND . NAR ( R , C ) .LT.230)  THEN 
NCT46-NCT46+1 

ELSEI F( NAR( R,  C ) .GE . 230 . AND. NAR ( R, C ) . LT. 235 )  THEN 
NCT47-NCT47+1 

ELSEIF( NAR( R, C ) .GE . 2 3 5 . AND . NAR ( R , C ) . LT. 240 )  THEN 
NCT48-NCT48+1 

ELSEI F(NAR(R,C) . GE . 240 . AND . NAR( R , C ) .LT.245)  THEN 
NCT49-NCT49+1 

ELSEI F( NAR (R,C) . GE . 2 4 5 . AND . NAR ( R , C ) .LT.250)  THEN 
NCT50-NCT50+1 

ELSEI F(NAR(R,C) . GE . 2 50 . AND . NAR ( R , C ) .LT.255)  THEN 
NCT51-NCT51+1 

ELSE 

NCT52-NCT52+1 

ENDir 
END  DO 
END  DO 

HIST( 1 , 1 ) - FLOAT ( NCTO ) 

HI ST ( 2 , 1 ) -FLOAT ( NCTl ) 

HIST( 3 , 1 ) ■ FLOAT ( NCT2 ) 

HIST( 4 , 1 ) -FLOAT ( NCT3 ) 

HI ST ( 5 , 1 ) -FLOAT ( NCT4 ) 

HIST(6,l)-FLOAT(NCT5) 

HIST ( 7 , 1 ) -FLOAT ( NCT6 ) 

HIST( 8 , 1 ) -FLOAT( NCT7 ) 

HIST( 9 / 1 ) -FLOAT( NCT8 ) 

HIST( 1 0 , 1 i -FLOAT ( NCT9 ) 

HIST(11,1)-FLOAT(NCT10) 

HIST( 12,1 ) -FLOAT (NCTl 1 ) 


hiST  (13, 1 ) -FLOAT ( NCT12 ) 

HIST  (  14,1) -FLOAT ( NCT1 3 ) 

HIST( 15, 1 ) -FLOAT ( NCT1 4 ) 

HI ST  {16 , 1 )-FLOAT(NCT15 ) 

HIST  (  17,1) -FLOAT ( NCT16 ) 

HIST ( 18,1 ) -FLOAT (NCT17 ) 

HIST ( 19,1 ) -FLOAT( NCT18 ) 

HIST ( 20 , l)-FLOAT(NCT19 ) 

HIST<  21 ,1 ) -FLOAT (NCT20 ) 

HI ST ( 22 , 1 ) -FLOAT ( NCT2 1 ) 

HIST( 23 , 1 ) -FLOAT ( NCT22 ) 

HIST( 24 , 1 )-FLOAT(NCT23) 

HI ST ( 2  5 , 1 ) -FLOAT ( NCT2  4 ) 

HIST ( 26,1) -FLOAT( NCT25 ) 

HI  ST ( 27 , 1 ) -FLOAT ( NCT26 ) 

HIST ( 28,1 ) -FLOAT (NCT27 ) 

HI  ST (29,1) -FLOAT (NCT28) 

HIST( 30,1 ) -FLOAT ( NCT29 ) 

HI ST ( 31, 1) -FLOAT (NCT30) 

HIST ( 32, 1) -FLOAT (NCT31) 

HIST ( 33,1) -FLOAT ( NOT 3 2 ) 

HIST ( 34,1 ) -FLOAT ( NCT3  3 ) 

HIST ( 35,1) - FLOAT ( NOT 3 4 ) 

HIST ( 36,1) -FLOAT ( NCT35 ) 

HIST ( 37,1 ) -FLOAT ( NCT36 ) 

HIST ( 38,1) -FLOAT ( NCT37 ) 

HIST ( 39,1 ) -FLOAT ( NCT38 ) 

HI ST ( 40,1 ) -FLOAT( NCT39 ) 

HIST( 41,1 ) -FLOAT (NCT40) 

HIST( 42, 1) -FLOAT (NCT41) 

HIST ( 43,1 )-FLOAT( NCT42 ) 

HI ST( 4  4 , 1 ) -FLOAT ( NCT4  3 ) 

HIST( 45,1 ) -FLOAT (NCT4 4) 

HIST (46,1 ) -FLOAT ( NCT4  5 ) 

HIST( 47,1 ) -FLOAT ( NCT46 ) 

HIST ( 48,1) -FLOAT ( NCT47 ) 

HIST ( 49,1 ) -FLOAT ( NCT48 ) 

HIST ( 50,1) -FLOAT ( NCT49 ) 

HIST ( 51 ,1 ) -FLOAT (NCT50 ) 

HI ST( 52,1 ) -FLOAT ( NCT51 ) 

HIST( 53,1 ) -FLOAT( NCT52 ) 

OPEN ( 31, FILE- 'HI ST. DAT' , STATUS- 'NEW' , FORM- ' FORMATTED ' ) 
DO  1-1,53 

WRITE( 31 , * ) HIST( 1,1) 

END  DO 
CLOSE ( 31) 

TOP-O . 

DO  1-1,53 

DI FF1— TOP— HIST (1,1) 

IF(Dirrl.LT.O)  THEN 
TOP-HIST( 1,1) 

END  IF 
END  DO 

DO  1-1,53 

DIFF2-TOP-HIST( 1,1) 

I F( DI FF2 . EQ . 0 )  THEN 
NLO-I 
NLOB-I 


END  IF 
END  DO 


DO  I-NLO, 53 

DIFF3-HIST(I,1) -TOPI 
IF(DIFF3.LE.O) THEN 
TOPl«HIST( 1,1) 

GOTO  29 
END  IF 
END  DO 

29  DO  I-NLO, 53 

DIFF4«TOPl-HIST( 1,1) 
I F ( DIFF4 . EQ . 0 )  THEN 
NHIB-I 
NHI-I 
END  IF 
END  DO 


DO  J-1,53 

DIFF5-HIST( J,l)-1000. 
I F ( DI FF5 . LT . 0 )  THEN 
GOTO  31 
END  IF 
END  DO 
31  NLOJ-J 

IF(NLOJ.LT.NLO)  THEN 
NLOB-NLOJ 
NLO-NLOJ 
END  IF 

IF(NLO.EQ.l)  THEN 
NLO-O 

ELSEIF( NLO. EQ. 2 )  THEN 
NLO-1 

ELSEIF( NLO. EQ. 3 )  THEN 
NLO-5 

ELSEI F ( NLO . EQ . 4 )  THEN 
NLO-IO 

ELSEI F( NLO. EQ. 5)  THEN 
NLO-1 5 

ELSEIF(NLO.EQ.6)  THEN 
NLO-20 

ELSEI F ( NLO . EQ . 7 )  THEN 
NLO-25 

ELSEI F ( NLO . EQ . 8 )  THEN 
NLO-30 

ELSEI F ( NLO . EQ . 9 )  THEN 
NLO-35 

ELSEI F ( NLO . EQ .10)  THEN 
NLO- 40 

ELSEI F ( NLO . EQ .11)  THEN 
NLO-45 


ELSEI F ( NLO . EQ .12)  THEN 
NLO- 50 

ELSEIF( NLO. EQ. 13 )  THEN 
NLO-55 

ELSEI F ( NLO . EQ .14)  THEN 
NLO-60 

ELSEI F ( NLO . EQ .15)  THEN 
NLO-65 

ELSEI F ( NLO . EQ . 16 )  THEN 
NLO-70 

ELSEI F ( NLO . EQ . 17 )  THEN 
NLO« 7  5 

ELSEI F ( NLO . EQ . 18 )  THEN 
NLO-80 

ELSEI F ( NLO . EQ . 19 )  THEN 
NLO-85 

ELSEI F ( NLO . EQ . 20 )  THEN 
NLO-90 

ELSEI F ( NLO . EQ . 21 )  THEN 
NLO-95 

ELSEI F ( NLO . EQ .22)  THEN 
NLO-lOO 

ELSEI F ( NLO . EQ .23)  THEN 
NLO-105 

ELSEI F ( NLO . EQ .24)  THEN 
NLO-110 

ELSEI F ( NLO . EQ . 25 )  THEN 
NLO-115 

ELSEI F ( NLO . EQ . 26 )  THEN 
NLO-120 

ELSEI F ( NLO . EQ . 27 )  THEN 
NLO-125 

ELSEI F ( NLO . EQ . 28 )  THEN 
NLO-130 

ELSEI F ( NLO . EQ . 29 )  THEN 
NLO-135 

ELSEI F ( NLO . EQ . 30 )  THEN 
NLO-140 

ELSEI F( NLO. EQ. 31 )  THEN 
NLO-145 

ELSEI F ( NLO. EQ. 32 )  THEN 
NLO-150 

ELSEI F ( NLO . EQ . 33 )  THEN 
NLO-155 

ELSEI F ( NLO . EQ . 34 )  THEN 
NLO-160 

ELSEI F ( NLO. EQ. 35 )  THEN 
NLO-165 

ELSEI F( NLO. EQ. 36 )  THEN 
NLO-170 

ELSEI F ( NLO . EQ. 37 )  THEN 
NLO-175 

ELSEI F ( NLO . EQ . 38 )  THEN 
NLO-180 

ELSEI F ( NLO. EQ . 39 )  THEN 
NLO-185 

ELSEI F ( NLO . EQ .40)  THEN 
NLO-190 

ELSEI F ( NLO . EQ .41)  THEN 
NLO-195 


ELSEI F ( NLO . EQ .42)  THEN 
NLO-200 

ELSEI F ( NLO . EQ .43)  THEN 
NLO-205 

ELSEI F ( NLO . EQ . 44 )  THEN 
NLO-210 

ELSEI F ( NLO . EQ . 45 )  THEN 
NLO-215 

ELSEI F ( NLO . EQ . 46 )  THEN 
NLO-220 

ELSEI F ( NLO . EQ . 47 )  THEN 
NLO-225 

ELSEI F ( NLO . EQ . 48 )  THEN 
NLO-230 

ELSEI F ( NLO . EQ . 49 )  THEN 
NLO-235 

ELSEI F ( NLO . EQ . 50 )  THEN 
NLO-240 

ELSEI F ( NLO . EQ . 51 )  THEN 
NLO-245 

ELSEI F ( NLO . EQ . 52 )  THEN 
NLO-250 

ELSE 

NLO-255 

END  IF 

IF(NHI.EQ.l)  THEN 
NHI-0 

ELSEI F ( NHI . EQ . 2 )  THEN 
NHI-1 

ELSEI F( NHI . EQ . 3 )  THEN 
NHI  *5 

ELSEI F ( NHI . EQ. 4 )  THEN 
NHI-1 0 

ELSEI F( NHI . EQ . 5 )  THEN 
NHI-1 5 

ELSEI F( NHI . EQ . 6 )  THEN 
NHI-20 

ELSEI F( NHI . EQ. 7 )  THEN 
NHI -2 5 

ELSEI F( NHI . EQ. 8 )  THEN 
NHI- 30 

ELSEI F( NHI . EQ. 9 )  THEN 
NHI -3 5 

ELSEI F( NHI . EQ. 10 )  THEN 
NHI -40 

ELSEI F ( NHI . EQ . 11 )  THEN 
NHI -4 5 

ELSEI F( NHI . EQ . 12 )  THEN 
NHI-50 

ELSEI F ( NHI . EQ .13)  THEN 
NHI-55 

ELSEI F ( NHI . EQ .14)  THEN 
NHI-60 

ELSEI F( NHI . EQ. 15 )  THEN 
NHI-65 

ELSEI F( NHI . EQ. 16 )  THEN 
NHI-70 

ELSEI F ( NHI . EQ . 17 ) 

NHI -7 5 


THEN 


EiiSEI  F  (  NHI  .  EQ  .  18  )  THEN 
NHI-80 

ELSEIF( NHI . EQ. 19 )  THEN 
NHI-85 

ELSEI F( NHI . EQ . 20 )  THEN 
NHI-90 

ELSEI F ( NHI . EQ . 21 )  THEN 
NHI -9 5 

ELSEI F ( NHI . EQ .22)  THEN 
NHI-100 

ELSEIF(NHI.EQ.23)  THEN 
NHI-105 

ELSEI F ( NHI . EQ . 24 )  THEN 
NHI-110 

ELSEIF(NHI .EQ.25)  THEN 
NHI-115 

ELSEI F ( NHI . EQ . 26 )  THEN 
NHI-120 

ELSEI F( NHI . EQ. 27 )  THEN 
NHI-125 

ELSEI F ( NHI . EQ . 28 )  THEN 
NHI-130 

ELSEI F ( NHI . EQ . 29 )  THEN 
NHI-135 

ELSEIF(N.EQ.30)  THEN 
NHI-140 

ELSEI F( NHI . EQ. 31 )  THEN 
NHI-145 

ELSEI F ( NHI . EQ . 32 )  THEN 
NHI-150 

ELSEI F ( NHI . EQ . 33 )  THEN 
NHI-155 

ELSEI F( NHI . EQ. 34 )  THEN 
NHI-160 

ELSEI F ( NHI . EQ. 35 )  THEN 
NHI-165 

ELSEI F ( NHI . EQ . 36 )  THEN 
NHI-170 

ELSEI F ( NHI . EQ . 37 )  THEN 
NHI-175 

ELSEI F ( NHI . EQ. 38 )  THEN 
NHI-180 

ELSEI F( NHI .EQ. 39)  THEN 
NHI-185 

ELSEIF(NHI .EQ.40)  THEN 
NHI-190 

ELSEI P( NHI . EQ. 41 )  THEN 
NHI-195 

ELSEI F( NHI . EQ. 42 )  THEN 
NHI *2 00 

ELSEI F( NHI . EQ. 4„ )  THEN 
NHI-205 

ELSEI F ( NHI . EQ . 44 )  THEN 
NHI >2 10 

ELSEI F ( NHI . EQ .45)  THEN 
NHI *2 15 

ELSEI F ( NHI . EQ . 46 )  THEN 
NHI-220 

ELSEI F( NHI . EQ. 47 ) 
NHI-225 


THEN 


E~SEIF( NHI . EQ. 48 )  THEN 
NHI-230 

ELSEIF( NHI . EQ. 49 )  THEN 
NHI-235 

ELSEIF( NHI . EQ . 50 )  THEN 
NHI-240 

ELSEIF(NHI .EQ. 51 )  THEN 
NHI-245 

ELSEIF(NHI .EQ. 52 )  THEN 
NHI-250 

ELSE 

NHI-255 

END  IF 


DO  1-1,53 

IF( HIST( 1,1) . LT . 1 ) THEN 
HIST ( I , 1 ) -1 . 

END  IF 

RLHI ST (1,1) -LOG1 0 ( HI ST ( I , 1 ) ) 
I F ( HIST (1,1) . EQ . 1 ) THEN 
HIST( I , 1 )*0 . 

END  IF 
END  DO 

CALL  MATSAV(1, MATRIX, 53, 53, 1,0, 
+  HIST, DUMMY, ' (1P2E25. 17)  '  ) 

CALL  MATSAV ( 1 , LOGMAT ,53,53,1,0, 
+  RLHIST, DUMMY, ' (1P2E25. 17) ' ) 

DO  1-1,53 

HIST( 1,1 )-0 . 

END  DO 

RETURN 

END 
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SUBROUTINE  MATSAV  (  LUNIT,  NAME,  NR,  M,  N,  IMG, 
$  XREAL,  XI MAG,  FORMT  ) 


MATRIXx  TM  Software  V7 . 0  (C)  Copyright  1988 

INTEGRATED  SYSTEMS  INC.,  Santa  Clara,  California 

Published  Work.  Permission  is  granted  to  any  individual  or 
institution  to  modify,  copy  or  use  this  subroutine  except  for 
explicitly  commercial  purposes. 


MATSAV  writes  a  matrix  to  a  file  in  a  MATRIXx-readable  format.  It 
can  be  called  by  programs  that  want  to  write  data  to  MATRIXx. 

Files  written  with  MATSAV  can  be  read  into  MATRIXx  with  the  LOAD 
command . 


Param. 

|  Type 

|  On  input-  | 

On  output- 

LUNIT 

1 

|  INTEGER 

i 

1  1 

|  Fortran  logical  unit  number.  | 

i  i 

unchanged . 

NAME 

j  CHARACTER* ( * ) 
j  (maximum 
|  length  10) 

|  Name  of  the  matrix.  One  al-  | 

|  phabetic  followed  by  up  to  9  j 
j  alphanumeric  characters.  | 

i  i 

unchanged . 

NR 

|  INTEGER 

1 

1 

1 

1 

1  I 

|  Row-dimension  in  the  | 

j  defining  dimension  ur  type  | 

j  statement  in  the  calling  j 

|  program.  NR  must  be  greater  j 

1  than  or  equal  to  M.  j 

1  1 

unchanged . 

M 

|  INTEGER 

1  I 

|  Number  of  rows  of  the  matrix  | 

1  1 

unciiaayed  . 

N 

i  INTEGER 

1 

1 

1  1 

|  Number  of  columns  of  the  | 

|  matrix.  j 

1  1 

unchanged . 

IMG 

j  INTEGER 

1 

1 

!  1 

|  If  IMG  -  0,  the  imaginary  | 
j  part  (XIMAG)  is  assumed  to  j 
j  be  zero  and  is  not  saved.  j 

unchanged . 

XREAL 

1 

|  DOUBLE 
j  PRECISION 

i 

1  1 

|  Real  part  of  the  matrix  to  | 

j  be  saved.  j 

unchanged . 

XIMAG 

j  DOUBLE 
|  PRECISION 

i 

l  1 

j  Imaginary  part  of  the  matrix  | 

j  to  be  saved.  j 

1  t 

unchanged . 

FORMT 

1 

|  CHARACTER* ( *  ) 
j  (maximum 
j  length  20) 

1 

1 

1  1 

|  String  containing  the  For-  | 

|  tran  format  to  be  used  for  | 

j  writing  the  elements  of  the  j 

j  matrix.  j 

1  I 

unchanged . 

1 

1 

1 

1  I 

|  For  machine-independent  files | 

|  use  '  ( 1P2E25.17) '  | 

|  t 

1 

1 

1 

1 

|  For  machine-dependent  (fast,  | 
j  compact)  files  use  ' (10A8)'  j 
|  or  '  ( 10Z16 ) '  | 

non  non  nnnn  n n n n n n n n n n n n n n n n n n n n n n n n n n n n n n o n n n 


Example:  The  following  Fortran  program  generates  a  simple 

identity  matrix  in  X  and  writes  it  to  Fortran  unit  1. 
Assume  that  unit  1  has  been  preallocated  as  file  (data 
set)  TEST. 

DOUBLE  PRECISION  X<20,3),  DUMMY 
DO  200  J-1,3 
DO  100  1-1,10 
X( I , J ) -0 . 0D0 
100  CONTINUE 

X( J,J)-1.0D0 
200  CONTINUE 

CALL  MATSAV(  1,  'AMATRIX',  20,  10,  3,  0, 

$  X,  DUMMY,  ' (1P2E25.17) *  ) 

STOP 

END 


After  this  program  runs,  invoke  MATRIXx  and  type: 

<>  LOAD  'TEST' 

This  will  put  X  on  the  stack  as  a  variable  named  AMATRIX. 

When  the  objective  is  to  convert  a  file  written  by  another  soft¬ 
ware  package  into  a  MATRIXx-readable  file,  you  will  have  to  write 
a  small  program  that  reads  the  data  in  using  the  format  of  the 
other  software  package  then  writes  it  out  by  calling  MATSAV. 


INTEGER  LUNIT,  M,  N,  NR,  IMG 

CHARACTER* ( * )  NAME,  FORMT 

DIMENSION  XREAL ( NR , * ) ,  XIMAG( NR, * ) 

CHARACTER  NAM*10,  FORM*20 


|  write  header  record. 


NAM-NAME 
FORM- FORMT 

OPEN( LUNIT, FILE-NAM, STATUS-'NEW' ) 

WRITE (LUNIT, ' ( A10 , 3l 5 , A20 ) ' )  NAM , M , N , IMG, FORM 


|  write  real-part  of  the  matrix. 


WRITE ( LUNIT, FORM)  ( ( XREAL ( I , J ) , 1-1 , M ) , J-1,N) 


|  write  imaginary-part  if  nonzero. 


IF(IMG.NE.O)  WRITE( LUNIT, FORM)  ( ( XI MAG ( I , J ) ,1-1, M) ,J-1,N) 


CLOSE( LUNIT) 


nnoon  oonno 


RET JRN 
END 


C 


SAME  GET  IMAGE  SUBROUTINE  FOUND  IN  BSG.FOR 


C 


SUBROUTINE  GET_FL I R_I M ( NAME , AR , ROW_NUM , COL_NUM ) 
IMPLICIT  INTEGER(A-Z) 

BYTE  AR  BYTE (240,640) 

DIMENSION  ART 240/640) 

CHARACTER* 2 4  NAME 

OPEN ( 1 0 , F I LE-NAME , STATUS- ' OLD ' , FORM- ' UNFORMATTED ' , 
+  RECORDTYPE- ' VARIABLE ' ,ERR-20 ) 

20  OPEN ( 10, FI LE-NAME, STATUS- 'OLD' , FORM- ' UNFORMATTED ' , 

+  RECORDTYPE- ' FIXED ' ) 


DO  100  R  -  1 , ROW_NUM 

READ (10)  ( AR_BYTE ( R , C ) , C-l , COL_NUM ) 

100  CONTINUE 


DO  R  -  1 , ROW_NUM 

DO  C  -  1 , COL_NUM 

I F ( AR_B YTE ( R , C ) . LT . 0 ) THEN 
AR(R,5)  -  AR_BYTE( R,C)+256 
ELSE 

AR ( R , C )  -  AR_BYTE( R, C ) 

END  IF 

END  DO 

END  DO 
CLOSE(IO) 

RETURN 

END 


C 


SAME  SUBROUTINE  FOUND  IN  BSG.FOR 


C 


SUBROUTINE  PUT  FLIR  IM( NAMEOUT , AR , ROW_NUM , COL_NUM ) 
IMPLICIT  INTEGER  lA-Z) 


DIMENSION  AR( 240,640) 

BYTE  AR_BYTE (240,640) 

CHARACTER* 2 4  NAMEOUT 

DO  R— 1 , ROW_NUM 

DO  C-l,COL_NUM 

AR  BYTE (R,C)-MOD(AR(R,C) ,256) -128 

END  DO 

END  DO 

OPEN (20, FI LE-NAMEOUT , STATUS- ' NEW ' , FORM- ' UNFORMATTED ' , 
RECL-COL_NUM/4  +  l ,  RECORDTYPE- '  FIXED'  ) 

DO  100  R»1 , ROW  NUM 

WRITE(IO)  (AR  BYTE( R, C ) , C-l , COL  NUM) 

100  CONTINUE 
CLOSE ( 20 ) 

RETURN 

END 


Appendix  E.  Regions  of  interest  FORTRAN  source  code. 


SHOW  LAB  PLIR_IM. FOR 


SYNOPSIS:  The  SHOW_LAB_PLIR_IM  program  uses  UIS  system  library 

routines  for  graphic  screen  displays.  This  program  determines  the 
center  pixel  of  every  "blob"  that  passed  through  the  THRESH__ADD_HIST 
program.  From  these  on  center  pixels,  a  table  of  locations  is 
generated.  The  total  number  of  on  center  pixels  and  their 
respective  locations  are  used  to  determine  the  number  of  jets  and 
their  location  for  generation. 

INPUT:  Thresholded  Gabor  filtered  image. 

OUTPUT:  To  the  screen,  a  labeled  version  of  the  thresholded  image. 
The  total  number  of  locations  of  on  center  pixels. 

The  locations  of  the  on  center  pixels. 


PROGRAM  show_lab_f li r_im 

IMPLICIT  INTEGER  (A-Z) 

INCLUDE  ' SYS$ LIBRARY : UI SENTRY ' 
INCLUDE  ' SYS$ LIBRARY : UISUSRDEF  ' 


INTEGER*4 

INTEGER*4 

BYTE 

INTEGER*4 
INTEGER*4 
CHARACTER* 1 
CHARACTER* 40 
REAL 


F_CR( 255 ) ,  F_CC (  255 )  ,  ROWMAX(255) 

ROW  MIN( 255 ) ,  COL_MAX( 255T,  COL  MIN(255) 

F_IM( 640,240) 

F  HOLD( 640,240) ,  WIN  NUM(200),  TFLIR( 640 , 240 ) 
TFl (240,640) ,  TF2(24ff,640) 

CONT,  ER 

Nl,  N2 ,  OUT_NAME 
INTEN 


TYPE*, 'PROGRAM  TO  ASSIST  ALIGNMENT  OF  FLIR  AND  LR  BLOBS' 
TYPE*,'  ' 

TYPE*, 'WHEN  PROMPTED,  ENTER  THE  NAMES  OF' 

TYPE*, 'PREVIOUSLY  SEGMENTED  FLIR  IMAGES' 

TYPE*,'  ' 

VCM_ID  -  UIS$CREATE_COLOR_MAP( 256 ) 

VD_ID  -  UIS$CREATE_DISPLAY( 0.0,  0.0,  640.0,  240.0,  20.0,  20.0, 

VCM  ID) 


DO  10  1-1,250 

INTEN  -  1/256.0 

CALL  UISSSET  INTENSITY ( VD  ID ,( 1-1 ), INTEN ) 


CONTINUE 

call  uis$set  color( vd_id,250. 

1.0, 

1.0, 

1.0) 

call  uis$set  color ( vd_id, 251 , 

0.0, 

0.0, 

0.0) 

call  uis$set  color(vd  id, 252, 

0.5, 

0.5, 

0.5) 

call  uis$set  color(vd  id, 253, 

1.0, 

1.0, 

1.0) 

call  uis$set  color ( vd_id, 254 , 

1.0, 

1.0, 

1.0) 

call  uis$set_color( vd_id,255, 

0.0, 

0.0, 

0.0) 

LAST-1 

WIN  COUNT- 0 

CONT-' Y' 

DO  5000  WHILE  (( CONT . EQ .' Y '). OR. ( CONT . EQ .' y ') ) 

type*, 'ENTER  FILENAME  OF  FLIR  IMAGE:' 
accept  50,  nl 
format( a ) 

type*, 'SEARCHING  TOR  FLIR  FILE' 

open(unit-10,  file-nl,  status-'old' ,  form-'unformatted' , 
recordtype-' variable' ,  err-90) 
open(unit-10,  file-nl,  status-'old',  form-'unformatted', 
recordtype-' fixed' ) 
type*, 'FOUND  FLIR  FILE' 

rewind  (10)  (MANUALLY  SET  POINTER  TO  FILE  AT  TOP  OF  FILE 

READ  THE  FLIR  IMAGE 
DO  130  J-1,240 

READ(10)  ( F_IM( I , J ) ,  1-1,640) 

CONTINUE 
CLOSE( 10) 


C  CONVERT  FLIR  IMAGE  TO  INTEGER  FORMAT 

DO  170  1-1,640 
DO  190  J-1,240 

IF  (F_IM( I, J) .LT.O)  THEN 

TFLIMI,J)  -  F_IM(  I ,  J  )  +  256 

ELSE 

TFLIR( I , J )  -  F_IM ( I ,  J ) 

END  IF 

TFl ( J , I )  -  TFLIR( I , J )  ! ROTATE  FOR  PROPER  LABELLING  OF 

1  SEGMENTED  IMAGE 

190  CONTINUE 

170  CONTINUE 

C  LABEL  REGIONS  IN  THE  FLIR  IM/GE 

CALL  LABEL_REG( TFl ,  240,  640,  F_MAX,  TF2 ) 

C  ROTATE  BACK  FOR  DISPLAY  PURPOSES 

DO  1-1,240 
DO  J-1,640 

F_HOLD( J , 1 )  -  TF2 ( I , J ) 

END  DO 
END  DO 

write (*,101)  f_max 

101  format ( '  NUMBER  OF  FLIR  REGIONS  DETECTED  -  ',14; 

OPEN ( 47 , FILE- ' TCT . DAT' , STATUS- ' NEW ' , FORM- ' FORMATTED ' ) 

WRITE( 47 , * ) f_max 
rLOSE( 47 ) 


C  INITIALIZE  HOLDING  VARIABLES 

DO  1-1 , FMAX 

COL_MAX(I)  -  0 
COL__MIN (  I )  -  641 
ROW_MAX(I)  -  0 
ROW_MIN(I)  -  241 
END  DO" 

C  FIND  MAX  AND  MIN  EXTENT  OF  3ACH  REGION 

DO  1-1,640 
DO  J-1,240 

IF  ( F_HOLD ( I , J ) . NE . 0 )  THEN 
TREG  -  F_HOLD(I,J) 

IF  ( I . GT . COL_MAX ( TREG ) )  THEN 
COL_MAX(TREG)  -  I 
END  IF 

IF  ( I . LT . COL_MIN ( TREG ) )  THEN 
COL_MIN ( TREG )  -  I 
END  I F 

IF  ( J . GT . ROW_MAX ( TREG ) )  THEN 
ROW_MAX ( TREG )  -  J 
END  IF 

IF  ( J . LT . ROW_MIN( TREG ) )  THEN 
ROW_MIN ( TREG )  -  J 
END  IF 
END  IF 
END  DO 
END  DO 


DO  1-1 , F_MAX 

F_CR(I)  -  ( ROW_MAX ( I )  +  ROW_MIN( I ) )/2 
F_CC ( I )  -  ( COL_MAX ( I )  +  COL_MIN( I ) )/2 
END  DO 

TYPE*, 'LOCATION  TABLE  FOR  CENTER  PIXELS  IN  FLIR  IMAGE' 

TYPE* ,' REGION  ROW  COL' 

OPEN ( 47,FILE«'LFP. DAT ' , STATUS- ' NEW' , FORM- ' FORMATTED ' ) 

DO  111  K-1,F  MAX 

WRITE  (*,T16)  K,  F_CR( K ) ,  F_CC(K) 

WRITE ( 47, *)F_CR(K) , F_Cu(K) 

116  FORMAT (14,'  ',14,'  ',14) 

111  CONTINUE 

CLOSE ( 47 ) 

C  PREPARE  FLIR  IMAGE  FOR  DISPLAY 

DO  410  1-1,640 
DO  430  J-1,240 

IF  (F_HOLD( I, J) .NE.O)  THEN 
F_IM( I , J )  -  -126 
ELSE 

F_IM( I , J )  -  0 
END  IF 

430  CONTINUE 

410  CONTINUE 

C  TURN  ON  PIXELS  DETERMINED  TO  BE  CENTER  PIXELS 

DO  412  I  — 1 ,  F  MAX 

f_iM(F_CCTI) ,F_CR(I) )  -  -7  1-7  IN  2'S  COMP  -  249  IN  UNSIGNED  LINGO 
412  CONTINUE 

CALL  DISPLAY_DRIVER1( VOID,  F  IM,  240,  640,  15,  17,  Nl , 

1  22.0,  9.U,  640.0,  240.0,  WD_ID,  F_CR, 

1  F  CC,  F_MAX) 

WIN_COUNT-WIN_COUNT  +  T 
WIN_NUM(WIN_COUNT)  -  WD_ID 

write( * , 690 ) 

690  format ( '  CONTINUE?  (Y/N)  >  ',$) 

accept  710,  cont 
710  format(al) 


write  (*,730) 

730  formats  ERASE  CURRENT  IMAGES?  (Y/N)  >  ',$) 

accept  750,  er 
750  format(al) 

if  ( ( er .eq. ' Y' ) .or . ( er .eq. 'y ' ) )  then 
DO  770  I-LAST, WIN  COUNT 

CALL  UIS$DELETf_WINDOW(WIN_NUM( I ) ) 

770  CONTINUE 

LAST-WIN_COUNT  +  1 
END  IF 

5000  CONTINMU 


END 


c 


SUBROUTINE  LABEL_REG( IM_IN,  ROW,  COL,  NUM  REG,  IM  OUT) 
IMPLICIT  INTEGER ( A-Z ) 


C 


DIMENSION 

INTEGER 

INTEGER 

INTEGER 


IM_IN ( ROW , COL ) ,  IM  OUT(ROW,COL) 
STAT( 640,640) 

NN_ROW (256*640),  NN  COL(256*640) 
FLAG ( 8 ) 


INITIALIZE  NEEDED  VARIABLES 
DO  R«1 , ROW 
DO  C-l,COL 

IM_OUT(R,C)  -  0 
STAT ( R , C )  -  0 

! SET  OUTER  ROWS, COLS  EQUAL  TO  ZERO 
IF  ( (R.EQ. 1 ) .OR. (R.EQ.ROW) .OR. 

(C.EQ.l) .OR. (C.EQ.COL) )  THEN 
IM_IN(R,C)  -  0 
END  IF 
END  DO 
END  DO 

DO  I-l,ROW*COL 
NW  ROW(I)  -  0 
N  COL ( I )  -  0 
END  L)0 
REG  CNT  -  0 


C  BEGIN  REGION  LABELLING  SCHEME 

DO  R-2, (ROW-1) 

DO  C-2, (COL-1) 


! WHEN  NONZERO  PIXEL  IS  FOUND,  BEGIN 

IF  ( (IM_IN(R,C) .NE.O) .AND. (STAT(R,C) .EQ.O) )  THEN 

LEN  -  0 
IND  -  0 

REG_CNT  -  REG_CNT  +  1 
IM_OUT(R,C)  -  REG_CNT 

! SEARCH  NEAREST  NEIGHBORHOOD  OF  NONZERO  PIXEL 
K  -  0 

DO  I  -  -1,1 
DO  J  -  -1,1 

K-K+l 

l IF  NEAREST  NEIGHBORS  ARE  FOUND  ON,  THEN 
! SEED  NEAREST  NEIGHBOR  TABLE 
IF  ( (IM_IN(R+I, C+J) .NE.O) .AND. 

( STAT( R+I, C+J) .EQ.O) )  THEN 

LEN  -  1 

NN_ROW( LEN )  -  R+I 
NN_COL ( LEN )  -  C+J 
FLAG(K)  -  1 

IM_OUT( R+I , C+J )  -  REG  CNT 
ELSE 

FLAG(K)  -  0 
END  IF 

STAT ( R+I , C+J )  -  1 


EXAMINE  NEAREST  NEIGHBOR  TABLE  AND  APPEND  OTHER  NEAREST 
NEIGHBORS  FOUND  BAREST 

FI  -  0 
DO  1-1,8 

IF  ( FLAG( I ) . NE . 0 )  THEN 
FI  -  1 
END  IF 
END  DO 

IF  (F1.NE.0)  THEN 

DO  WHILE  ( ( IND. LT. LEN) .OR. ( Fl . EQ . 1 ) ) 

DO  1-1,8 

FLAG(I)  -  0 
END  DO 

IND  -  IND  +  1 

TR  -  NN_ROW(IND) 

TC  -  NN_COL ( IND ) 

K— 0 

DO  1  —  1,1 
DO  J— 1,1 
K-K+l 

IF  (  (  IM_IN(TR+I,TC+J)  .  .  0  )  .AND  . 

( STAT ( TR+I , TC+J ) . EQ . 0 ) )  THEN 
LEN-LEN+1 

NN_ROW ( LEN )  -  TR+I 
NN_COL ( LEN )  -  TC+J 
IM_OUT( TR+I , TC+J )  -  REG  CNT 
FLAG(K)  -  1 
END  IF 

STAT( TR+I , TC+J)  -  1 
END  DO 
END  DO 
Fl  -  0 
DO  1-1,8 

IF  (FLAG(I).NE.O)  THEN 
Fl  -  1 
END  IF 
END  DO 

END  DO 


END  ir 


ELSE 


STAT ( R , C )  -  1 


END  IF 


END  DO 
END  DO 

NUM_REG  -  REG  CNT 


RETURN 


END 


- - 

C  A  SUBROUTINE  TO  DRIVE  THE  VAX  STATION  II  DISPLAY  FOR  RASTER  IMAGES 
C 

C  INPUTS  ARE  THE  VIRTUAL  COLOR  MAP  ID,  VCM_ID,  THE  IMAGE  ARRAY  IN  BYTE 
C  FORMAT,  NUMBER  OF  ROWS  AND  COLUMNS,  X.Y  CDS  OF  LOWER  LEFT  CORNER 
C  OF  RASTER  IMAGE  AS  IT  WILL  APPEAR  IN  THE  DISPLAY  WINDOW, 

C  A  NAME  TO  BE  PLACED  IN  THE  DISPLAY  BANNER,  THE  X  AND  Y  EXTENT 

C  OF  THE  WINDOW  FOR  DISPLAYING  THE  IMAGE,  AND  THE  SIZE  IN  X  AND  Y 

C  DIMENSIONS  OF  THE  VIRTUAL  DISPLAY  WINDOW  OPPENED  IN  THE  MAIN. 

C 

C  OUTPUT  IS  THE  DISPLAY  OF  THE  IMAGE  AND  THE  WINDOW  ID  NUMBER,  WD_ID, 

C  OF  THE  CURRENT  WINDOW  OPEN. 

SUBROUTINE  01 SPLAY_DRIVERl 

1 
1 
1 
1 

IMPLICIT  INTEGER  (A-Z) 

CHARACTER* 4  CHAR 

INCLUDE  ' SYS$LIBRARY :UI SENTRY' 

INCLUDE  ' SYS$ LIBRARY : UI SUSRDEF ' 

REAL  X_SIZE,  Y_SI ZE ,  VD_X_SIZE,  VD  Y_SIZE 

DIMENSION  IMAGE ( COL  NUM,  ROW_NUMT  S  IMAGE  IS  PASSED  IN  IN  BYTE  TYPE 
DIMENSION  COL_TABLETNUM_EL) 

DIMENSION  ROW_TABLE(NUM_EL) 

character*40  outname 

WD_ID  -  UIS$CREATE_WINDOW( VD  ID , ' SYS$WORK STATION ' , NAME , 

1  0.ff,0.0,VD_X_SIZE,  VD_Y_S I Z  E , 

1  X_SIZE,  Y_SIZE) 

CALL  UI S$SET_WRITING_MODE ( VD_ID ,  0,1, UI S$C_MODE_COPY ) 

CALL  UI SDC$ IMAGE ( WD_I D , 1 , X_LOWER_LEFT , Y_LOWER_LEFT , 

1  X_LOWER_LEFT  +  COL_NUM, 

1  Y_LOWER_LEFT  +  ROW  NUM, 

1  COL_NUM,  ROW_NUM,  S,  IMAGE) 

CALL  UIS$SST_WRITING_INDEX(VD_ID,  0,  2,  249) 

CALL  UIS$SET_FONT( VD_ID,  2,  2, 

1  ' DTABER0I03WK00GG0001UZZZZ02A000 ' ) 

CALL  UIS$SET_WRITING_MODE{ VD_ID,  2,  2,  UI S$C_MODE_OVER ) 

DO  100  I«1,NUM  EL 

X-COl_tableTl )  -  3  +  X  LOWER_LEFT 

Y-ROW_NUM  -  row_table(lT  +  2  +  Y_LOWER_LEFT 
ENCODE ( 4 ,  2000, CHAR)  I 
2000  FORMAT (14) 

CALL  UI SDC$TEXT ( WD_ID ,  2,  CHAR,  X,  y  ) 

100  CONTINUE 

CALL  UISDC$TEXT(WD  ID,  2,  'ORIG',  10,10) 


( VD_ID ,  IMAGE,  ROW_NUM,  COL_NUM, 
X_LOWER_LEFT,  Y_LOWER_LEFT ,  NAME, 
X_S I ZE ,  Y_S I ZE ,  VD_X_SIZE , 
VD_Y_SIZE ,  WD_ I D ,  ROW_TABLE, 

COL  TABLE,  NUM  EL) 


c  This  section  changed  by  K  Ayer  for  saving  file  for  output  to  laser 
c  printer 


type* , 'What  do  you  wish  to  call  the  output  image  file?' 
accept  50,  out  name 

call  put_f li r_Tm( out_name , image ,240,640) 

5C  format(a) 

RETURN 

END 


SUBROUTINE  PUT_FLIR  IM ( NAMEOUT , AR , ROW_NUM , COL_NUM ) 
IMPLICIT  INTEGER  TA-Z) 

DIMENSION  AR( 240,640) 

BYTE  AR_BYTE (240,640) 

CHARACTER *2 4  NAMEOUT 

DO  P-l,ROW_NUM 

DO  C-l,COL  NUM 

a  r_by teT  r , c ) -mod (ar(r,c),256)-128 
END  DO 

END  DO 

OPEN ( 20 , FILE-NAMEOUT , STATUS- ' NEW ' , FORM- ' UNFORMATTED ' , 
+  RECL— COL_NUM/4+l , RECORDTYPE- ' FIXED ' ) 

DO  100  R-l , ROW  NUM 

WRITE(IO)  ( AR_BYTE ( R , C ) , C-l , COL_NUM ) 

100  CONTINUE 
CLOSE( 20  ) 

RETURN 

END 


Appendix  P.  Image  display  FORTRAN  source  code. 


DISPLAY_IMAGES . FOR 


SYNOPSIS!  DISPLAY_IMAGES  program  displays  PLIR  and  LADAR  images 
based  on  user  defined  inputs.  This  program  converts  a  two's 
complement  BYTE  stored  image  into  proper  format  for  UIS  display 
routines.  Most  of  this  program  is  for  LADAR  image  display  and  is 
not  pertinent  to  this  research  effort.  However,  those  portions  for 
FLIR  image  display  take  a  240  by  640  pixel  image,  convert  it  into 
UIS  format  for  screen  display.  Color  maps,  mouse  connands,  and 
other  UIS  display  routines  may  be  found  in  the  UIS  SYS$LIBRARY 
graphics  packages  readily  accessible  on  most  MicroVAX  Workstations. 

Image  Display. 

Hardware .  Images  generated  by  the  FORTRAN  codes  found  in 
Appendix  C,  D,  and  E  were  displayed  using  a  Digital  Corporation 
VaxStation  3  mini  mainframe  computer  with  a  Digital  Corporation  19 
inch  multisync,  multicolor  cathode  ray  tube  (CRT). 

Software.  The  FORTRAN  code  required  to  display  the  images  on 
screen  was  provided  by  Capt  Michael  Roggemann.  This  code  was  not 
intended  for  general  purposes,  but  rather  for  the  specific  use  of 
displaying  FLIR  and  Laser  Radar  (LADAR)  images. 

This  display  program  incorporated  the  UIS  (VAX  graphics 
display  language)  display  routines  specific  to  VMS  MicroVax 
workstations,  and  therefore,  was  not  portable  to  other  operating 
systems.  This  statement  should  not  be  construed  as  a  limitation  on 
the  Gabor  transform  to  segment  images  but  rather  a  limitation  on  the 
display  of  the  Gabor  filtered  images. 

INPUT:  PLIR  or  LADAR  image(s). 

OUTPUT:  Screen  display  of  FLIR  or  LADAR  image(s). 
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C  A  MAIN  PROGRAM  TO  DISPLAY  FLIR  AND  LASER  RADAR  IMAGES  ON  A  MICROVAX 
C  WORKSTATION  DISPLAY  USING  UIS  DISPLAY  ROUTINES. 

C 

C  THIS  PROGRAM  IS  NOT  A  GENERAL  DISPLAY  PROGRAM.  IT  IS  SPECIFICALLY  WRITTEN 

C  TO  DISPLAY  FLIR  IMAGES  STORED  IN  BYTE  FORMAT  (1  BYTE/PIXEL, 

C  AND  LASER  RADAR  RESOLVED  RANGE  IMAGES  STORED  IN 
C  INTEGER  FORMAT  (4  BYTE/PIXEL). 

C 

C  USER  OPTIONS  ARE  AVAILABLE  TO  SELECT  THE  FOLLOWING: 

C  -  TYPE  OF  IMAGE  TO  BE  DISPLAYED;  FLIR  OR  LASER  RADAR  RESOLVED  RANGE 

C  -  WHETHER  OR  NOT  THE  IMAGE  IS  TO  BE  VIEWED  IN  COLOR 

C  -  SIZE  OF  LASER  RADAR  IMAGE.  THREE  SIZES  SUPPORTED: 

C  --  127  COL  BY  64  ROW 

C  —  255  COL  BY  128  ROW 

C  —  511  COL  BY  256  ROW 

C  -  WHETHER  OR  NOT  RANGE  UNITS  ARE  ADJUSTED  BY  A  FACTOR  OF  10  ( DIVIDED ) 

C  -  WHETHER  OR  NOT  A  MODULO  256  OPERATION  IS  APPLIED  TO  DISPLAY  FULL 

C  DYNAMIC  RANGE  OF  RESOLVED  RANGE  IMAGE 

C  ONLY  ONE  SIZE  OF  FLIR  IMAGE  IS  CURRENTLY  SUPPORTED:  640  COL  BY  240  ROW. 

C 

C  PROGRAMMED  BY:  CAPT  MIKE  ROGGEMANN,  COMPLETETED  9  JAN  88 

C - 

program  DISPLAY_IMAGES 

IMPLICIT  INTEGER  (A-Z) 

INCLUDE  ' S YS$LIBRARY : UIS ENTRY ' 

INCLUDE  ' SYS$ LIBRARY : UISUSRDEF ' 

INTEGER*  4  RNG_IM(  511 , 256 ) 

BYTE  FLIR_IM{ 256,256) ,  DISPLAY_IM( 256 , 256 ) 

BYTE  DISPLAY_IMl (127,64) , DISPLAY_IM2 (255,128) 

BYTE  DISPLAY_IM3 (511,256) 

CHARACTER* 40  NAMEl 

CHARACTER* 1  CONTINUE,  ADJUST,  MOD256,  DEL,  CLR 

CHARACTER* 1  CB 

REAL  TEMP,  QUO,  COLOR,  INTEN 

INTEGER*  4  WINDOW_NUM( 200 ) 

EQUIVALENCE  ( RNG_IM , RNG_HOLD ) 

type*,  '  ' 

type*, ’DISPLAY  PROGRAM  FOR  RESOLVED  RANGE  AND  FLIR  IMAGES' 
type*,  '  ' 
type*,  ’  ’ 

C  CREATE  A  COLOR  MAP 

!  VIRUTAL  COLOR  MAP  ID  NO.  FOR  GRAY  SCALE  DISPLAY 
VCMID1  -  UIS$CREATE_COLOR_MAP( 256 ) 

!  VIRTUAL  COLOR  MAP  ID  NO.  FOR  COLOR  DISPLAY 
VCM_ID2  -  UIS$CREATE_COLOR_MAP( 256) 

l  CREATE  DISPLAY  FOR  GRAY  SCALE  IMAGES 

VD_IDl  -  UIS$CREATE_DISPLAY( 0.0, 0.0, 256. 0,256. 0,20.0, 

1  8 . 0 , VCM_ID1 ) 

l  CREATE  DISPLAY  FOR  COLOR  IMAGES 

VD  ID2  -  UIS$CREATEDISPLAY( 0.0, 0.0, 256. 0,256. 0,20.0, 


1 


8.0, VCM  ID2) 


C  LOAD  THE  COLOR  ,  OR  GRAY  SCALE  MAP 

DO  10  i-1,256  !  FILLS  GRAY  SCALE  MAP 

INTEN  -  i/256.0 
j-i-1 

CALL  UIS$SET_INTENSITY(vd_idl, j , INTEN) 
10  CONTINUE 


CALL  FILL_COLOR_MAP(VD_ID2)  !  FILLS  COLOR  MAP 

C  ITERATION  CONTROL  FOR  DISPLAYING  MULTIPLE  IMAGES 
C  INITIALIZE  REQUIRED  VARIABLES 

LAST  -  1 

WINDOW_COUNT  -  0 
CONTINUE  -  'Y' 

DO  5000  WF '  .2  (  (CONTINUE. EQ . 'Y' ) .OR. (CONTINUE. EQ. 'y' )  ) 

C  GET  FILENAME  OF  FILE  TO  BE  DISPLAYED 

type* , ' ENTER  FILENAME  OF  IMAGE  TO  BE  DISPLAYED' 
accept  50,  namel 
50  format(a) 

C  QUERY  FOR  REQUIRED  USER  INPUT 

type*, 'IS  THE  FILE:  (1)  RESOLVED  RANGE  LASER  RADAR' 
type*,'  (2)  FLIR' 

wri te ( 5 , 100 ) 

100  format( '  ENTER  1  OR  2  >  ',  $) 

accept* , imagetype 
type* , '  ' 

wri te( * , 335 ) 

335  formats  DRAW  IN  COLOR? (Y/N)  >  ',$) 

accept  340,  clr 

340  format(al) 

write  ( * , 336 ) 

336  format (  '  DRAW  COLOR  BAR? ( Y/N )  >  ',$) 

accept  341,  cb 

341  format(al) 

C  SET  VD  ID  NUMBER  APPROPRIATE  FOR  EITHER  COLOR  OR  GRAY  SCALE  DISPLAY 
Tf  ( (clr.eq. 'Y' ) .or. (clr.eq. 'y' ) )  then 
VD_ID  -  VD_ID2 
else 

VD  ID  -  VD_IDl 
end  i? 

C  CONDITIONAL  HANDLING  FOR  RESOLVED  RANGE  IMAGES 
if  ( iraagetype.eq.l)  then 


C  OPEN  THE  FILE 

open ( unit-10 , f ile-naoel , status- 'old' , f orm- ' unformatted ' , 
recordtype-' variable ' ,  err-105) 


1 


C  OPEN  STATEMENT  TO  HANDLE  EXCEPTION  THAT  RECORDTYPE  «  FIXED 
105  open ( uni t-10 , f i 1 e-name 1 ,status-'old' , f orm- ' unformatted' , 

1  recordtype- ' f ixed ' ) 

rewind(lO)  1ASSURES  POINTER  SET  TO  TOP  OF  FILE 

type*, 'FILE  FOUND' 
type*,  '  ' 


C 


200 

C 

250 

275 

300 

325 

330 

355 


GET  IMAGE  SIZE  INFORMATION  FROM  USER 


type*, 'IS  THE  IMAGE 


9 

>*  ' 


type1  , 
type*,  ' 
wr i te ( 5 , 200 ) 
f ormat ( '  ENTER  1 ,  2 


(1)  64  ROW  BY  127  COL' 

(2)  128  ROW  BY  255  COL' 

( 3 )  256  ROW  BY  511  COL' 


OR  3  > 


$) 


accept* , image_si ze 
type* , '  ' 


QUERY  FOR  NEED  TO  ADJUST  RANGE  UNITS  AND  MODULO  256 
write ( * ,250 ) 

format( '  ADJUST  RANGE  UNITS  BY  FACTOR  OF  10?(Y/N)  >  ',$) 

accept  275,  adjust 

format( al ) 

type*,  '  ' 

write ( * , 300 ) 

f ormat ('  MODULO  256  FOR  DI SPLAY? ( Y/N )  >  ',$) 

accept  325,  mod_256 

format(al) 

type* , '  ' 

write( * , 330 ) 

format ( '  DISPLAY  RANGE  SLICE?  (Y/N)  >  ',$) 

accept  355,  rngslc 

format(al) 


C  GET  MEDIAN  RANGE  REQUIRED  FOR  RANGE  SLICE  OPTION 

if  ( ( rng  slc.eq. ' Y' ) .or . ( rng  slc.eq.'y'))  then 
wri teT* , 360 ) 

360  format( '  ENTER  MEDIAN  RANGE  OF  RANGE  SLICE  IN  UNITS',?, 

1  '  OF  THE  IMAGE  >  ' ,$ ) 

accept*,  med_rng 
end  if 


C  SET  IMAuK  SIZE  FOR  LATER  PROCESSING 
u  ( image_size .eq. 1 )  then 
row_num  -  64 
col_num  -  127 
end  if 

if  ( image_size.eq.2)  then 
row_num  -  128 
col_num  -  255 
end  i  f 

if  ( image_size.eq. 3)  then 
row_num  -  256 
col  num  -  511 
end  i  f 

C  READ  THE  IMAGE  FILE  INTO  A  TEMPORARY  ARRAY 
C  NOTE  THAT  THE  METHOD  OF  READING  RECORDS  DIFFERS  FROM  ADA 
C  THIS  FORMAT  FOR  READING  IMAGE  FILES  STORED  IN  ROW-MAJOR  FORMAT 


C  IS,  HOWEVER,  COMPATIBLE  WITH  THE  UIS  DRAWING  ROUTINES,  WHICH 
C  ASSUME  ARRAYS  PASSED  IN  ARE  IN  X,Y  FORMAT 
DO  350  j  ■  1 , row_num 

read(10)  ( rng_ira( i , j ) ,  i  -  l,col  num) 

350  CONTINUE 

type*, 'FILE  READING  COMPLETE' 

C  IF  REQUIRED,  ADJUST  RANGE  UNITS  BY  FACTOR  oF  10 

if  ( (adjust. eq. 'Y' ) .or. (adjust. eq. 'y' ) )  then 
DO  375  i  -  l,col_num 
DO  380  j  -  l,row_nura 

rng_im(i,j)  -  rng_im( i , j )/10 
380  CONTINUE 

375  CONTINUE 

type*, 'RANGE  UNITS  ADJUSTED' 
end  i  f 

C  IF  REQUIRED,  PERFORM  MODULO  256  OPERATION  TO  PREPARE  FOR  DISPLAY 
if  ((mod  256 . eq . ' Y ' ) . or . ( mod_2 56 . eq . ' y ' ) )  then 
DO  38?  i  -  l,col_num 
DO  390  j  -  l,row_num 
TEMPA  -  RNG_IM( i , j ) 
rng_im(i,j)  -  JMOD( TEMPA, 256 ) 

390  CONTINUE 

385  CONTINUE 

type*, 'MODULO  256  COMPLETE' 
end  i  f 

C  IF  REQUIRED,  COMPUTE  RANGE  SLICE  OF  IMAGE 

if  ( ( rng_slc . eq . ' Y' ) . or . ( rng_slc . eq . ' y ' ) )  then 
CALL  RANGE_SLICE  (rng_im,  256,  511,  med_rng) 
type*, 'RANGE  SLICE  COMPUTATION  COMPLETE' 
end  i  f 

C  ELIMINATE  PIXELS  AT  OR  ABOVE  250,  AS  DISPLAY  RESETS  THESE  TO  MANAGE 
C  DEFAULT  CONTROL  WINDOWS  TO  VARIOUS  SHADES  OF  GRAY 
DO  401  i-l,col_num 
DO  402  j-l,row  num 

if  ( rng  im(T, j ) , ge . 250 )  then 
rng_Tm(i,j)  -  249 
end  if 

402  CONTINUE 

401  CONTINUE 

C  CONVERT  FROM  INTEGER  TO  (SIGNED)  BYTE  FORMAT 
DO  410  i-l,col_num 
DO  420  j«l,row  am 

if  (rng  im( i , j ) . le . 127 )  then 
rng_Tm( i , j )-rng_im( i , j ) 

else 

rng_im( i , j )-rng_im( i , j )-256 
end  if 

420  CONTINUE 

410  CONTINUE 

C  NOW,  ASSIGN  ELEMENTS  OF  RNG_IM  TO  PROPERLY  SIZED  DISPLAY_IM  ARRAY 
C  AND  CALL  THE  UIS  DISPLAY  ROUTINES 


if  ( image_si ze . eq . 1 )  then  !  127  col  by  64  row  array 
DO  800  i«l,ccl_num 

DO  810  j«l,row  num 

di splay_imlTi , j )  -  rnq_im(i,j) 

CONTINUE 

CONTINUE 

type* , ' DISPLAY  IMAGE  READY' 

CALL  DI SPLAY_DRI VER( VD_ID,  DISPLAY  IMl ,  ROW_NUM, 

COL_NUM ,  28,  2?,  NAME1 , 

6.0,  4.0,  256.0,  256.0,  WD_ID) 

WINDOW_COUNT  -  WINDOW_COUNT  +  1 
WINDOW_NUM(WINDCW_COUNT)  -  r.vD_ID 

end  i  f 

if  { imagesize . eq . 2 )  then  !  128  row  by  255  col  array 
DO  820  i«l,col_num 
DO  830  j-l,row  num 

display_im2Ti , j )  *  rng_im(i,j) 

CONTINUE 

CONTINUE 

type* , 'DISPLAY  IMAGE  READY' 

CALL  DI SPLAY_DRI VER  (VD_ID,  DISPLAY  IM2,  ROW_NUM , 

COL_NUM ,  25,  2 5,  NAMEl ,  10.0, 

6.0,  256.0,  256.0,  WD_ID) 

WINDOW_COUNT  -  WINDOW_COUNT  +  1 
WINDOW_NUM(WINDOW_COUNT)  -  WD_ID 

end  i  f 

if  ( image_size . eq . 3 )  then  l  256  row  by  511  col  array 
DO  840  i-l,col_num 
DO  850  j-l,row  num 

display_im3Ti , j )  -  rng_im(i,j) 

CONTINUE 

CONTINUE 

type* , 'DISPLAY  IMAGE  READY' 

CALL  D I S P LA Y_DR I VER ( VD_ I D ,  DISPLAY  IM3,  ROW  NUM, 

COL  NUM,  19,  25,  NAMEl,  18.0, 

10.5,  256.0,  256.0,  WD_ID) 

WINDOW_COUNT  -  WINDOW_COUNT  +  1 
WINDOW_NUM(WINDOW_COUNT)  -  WD_ID 

end  i  f 

end  if  I  END  OF  CONDITIONAL  TREATMENT  OF  RESOLVED  RANGE  IMAGE 


DISPLAY  PREPARATION  FOR  FLIR  IMAGES 
if  ( image_type . eq . 2 )  then 
row_nu.T»  -  256 
col  nur  -  256 


C  OPEN  THE  FILE 

open ( uni t-10 , fi le-namel , status- ' old ' , form- ' unformatted 
1  recordtype-' variable' ,err-110 ) 

EXECPTION  HANDLER  FOR  CASE  WHEN  RECORDTYPE- FIXED 
.10  open(unit-10 , file-namel , status-' old' , form-'unformatted 

1  recordtype- ' fixed' , access- ' sequential ' ) 

rewind(lO)  1ASSURES  POINTER  SET  TO  TOP  OF  FILE 

type*, 'FILE  FOUND' 

C  GET  A  FLIR  IMAGE 

DO  600  j  -  l,row_num 

read(10)  ( display_im( i , j ) ,  i  -  l,col  num) 

CONTINUE 

PIXELS  AT  OR  ABOVE  250  TO  249 
DO  601  i-l,col_num 
DO  602  j«l,row_num 

if  ( ( display_im{ i , j ) . le .-1 ) . and. 

(display^iiM  i  ,  j  )  .  ge.-6  )  )  then 
display_im(  i  , "J)  -  -7 
end  if 
CONTINUE 
CONTINUE 

type*, 'DISPLAY  IMAGE  READY' 

C  CALL  REQUIRED  UIS  ROUTINES  TO  DISPLAY  THE  IMAGE 

CALL  DISPLAY_DRIVER(VD_ID,  DISPLAY  IM,  ROWNUM, 

1  COL_NUM,  15,  IT,  NAME1,  22.0, 

1  9.0,  256.0,  256.0,  WDID) 

WINDOW_COUNT  -  WINDOW_COUNT  +  1 
WINDOW_NUM(WINDOW_COUNT)  -  WD_ID 

end  if  !  END  OF  CONDITIONAL  TREATMENT  FOR  FLIR  IMAGES 

close  (10) 

C  MAKE  COLOR  BAR  IF  DESIRED 

if  ( ( cb.eq. ' Y' ) .or. (cb.eq. 'y' ) )  then 
CALL  MAKE_COLOR_BAR 
end  if 

C  CONTINUE  USER  INTERFACE  FOR  DISPLAYING  MULTIPLE  IMAGES 
write( *,700) 

700  formats  DISPLAY  ANOTHER  IMAGE? ( Y/N )  >  ',$) 
accept  725,  continue 
725  format(al) 

write( * ,750 ) 

750  formats  ERASE  CURRENT  IMAGES? ( Y/N )  >  ',$) 
accept  775,  del 
775  format(al) 


600 

C  SET  ALL 


1 


602 

601 


o  o 


if  ( (del.eq. '  Y ' ) .or. (del.eq. ' y ' ) )  then 

DO  781  I -LAST , WINDOW_COUNT 

CALL  UIS$DELETE  WINDOW( WINDOW  NUMflM 
781  CONTINUE  ~ 

LAST  -  WINDOW_COUNT  +  1 

end  i  f 

5000  CONTINUE 

DELETE  VIRTUAL  DISPLAY  IN  AN  ATTEMPT  TO  RETURN  SYSTEM  TO  PREVIOUS 
SETTINGS,  ETC 

CALL  UI S$DELETE_DI SPLAY ( VD_ID ) 
end 


Appendix  G.  Jet  generating  FORTRAN  source  code. 


JETS . FOR 


SYNOPSIS:  JETS. FOR  program  takes  the  locations  of  on  center  pixels 
generated  by  the  SHOW_LAB_FLIR_IM  program  and  builds  jets  at  these 
locations.  A  jet  is  a  "stack"  of  self  similar  Gabor  correlation 
coefficients  corresponding  to  the  various  Gabor  sizes  and 
orientations.  For  instance,  a  jet  may  consist  of  five  Gabor  sizes 
ranging  from  128  by  128  to  8  by  8  with  each  subsequent  layer 
decreasing  in  size  by  octaves,  witn  four  orientations  per  layer, 
thus  creating  a  five  layer,  four  sublayer  stack  of  Gabor 
coefficients  (20  coefficients  associated  with  each  location).  The 
program  generates  an  output  image  file  for  each  location  within  the 
image.  The  first  layer  of  the  "jetted"  image  consists  of  four 
orientations  (0,  45,  90,  and  135  degrees)  within  a  128  by  128  Gabor 
window  size.  The  second  layer  consist  of  four  orientations  within 
a  Gabor  window  of  64  by  64.  The  third  layer  consists  of  four 
orientations  within  a  32  by  32  Gabor  size  window.  The  fourth  layer 
consists  of  four  orientations  within  a  16  by  16  Gabor  window  size. 
The  five  layer  consists  of  four  orientations  within  an  eight  by 
eight  Gabor  widow  size. 


INPUT:  Self  similar  Gabor  filtered  PLIR  image(s). 

Total  number  of  locations  for  jet  construction. 

Locations  of  the  on  center  pixels  for  each  "blob"  in  the 

image. 

OUTPUT:  Jet  images  at  each  on  center  pixel  location. 
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C 


PROGRAM  TO  GENERATE  JETS  LOCATED  AT  POINTS  FOUND  BY  THE 
ROGGEMANN  CENTROID  FINDING  ALGORITHM,  SHOW_LAB_FLIR_IM 

ARRAYS  USED: 


NAR 

NSUM 

NJET 

XAR 

XSUM 

XJET 

AR  BYTE 


INTEGER  FORMAT  OF  INPUT  IMAGE 
INTEGER  FORMAT  OF  THE  SUPERIMPOSED 
SS_GABORED  IMAGES 

INTEGER  FORMAT  OF  THE  SUPERIMPOSED 

JET  COEFFICIENTS 

REAL  FORMAT  OF  INPUT  IMAGE 

REAL  FORMAT  OF  THE  SUPERIMPOSED 

SS_GABORED  IMAGES 

REAL  FORMAT  OF  THE  SUPERIMPOSED 

JET  COEFFICIENTS 

BYTE  FORMAT  OF  THE  INPUT  IMAGE 


VARIABLES  USED: 


NJET_LAYERS 

NSIZE 

NFLG_FILE 

ROW_NUM 

COL_NUM 

NFR 


NTOT 

NX,  NY 
RP ,  CP 

NH 

XTOP , RTOP , XT2 , 
XT 3, THE  MAX 


NUMBER  OF  JET  LAYERS 
SIZE  OF  THE  JET  LAYER  ( NXN ) 

OUTPUT  FILE  NAME  INDICATOR 

NUMBER  OF  ROWS 

NUMBER  OF  COLUMNS 

FLAG  TO  INDICATE  THE  STATUS  FOR 

READING  THE  PIXEL  LOCATIONS  OF 

THE  CENTROIDS.  NFR-1  INDICATES 

NOT  NECESSARY  TO  READ  THE  LOCATIONS 

TOTAL  NUMBER  OF  LOCATIONS  FOUND  BY 

ROCGEMANN ' S  ALGORITHM 

LOCATIONS  OF  THE  CENTROIDS  (X,Y) 

POINTERS  ASSOCIATED  WITH  CENTERING 

THE  JETS 

HALF  OF  NSIZE 

SAME  AS  THOSE  FOUND  IN  BSG.FOR 


WRITTEN  BY:  KEVIN  W.  AYER,  CAPT,  DATE:  19  JUN  89 


UPDATED  BY: 


DATE: 


C 


PROGRAM  JETS  MAIN 


DIMENSION 

DIMENSION 

DIMENSION 

CHARACTER* 2 4 

INTEGER 

BYTE 


NAR (  240,640) , NSUM ( 240 , 640 ) , NJET(  240 , 640 ) 
XAR< 240,640) , XSUM( 740 , 640 ) ,TOP(640) 

XJET( 240,640) 

NAME IN , NAMEOUT , NAME 
R , C , ROW  NUM , COL  NUM 
AR  BYTET240,640T 


NTOT  IS  A  VALUE  OBTAINED  BY  RUNNING  THE  SHOW  LAB  FLIR  IM  PROGRAM 


OPEN<  20, FILE- 'TOT. DAT' , STATUS- ' OLD'  , FORM- ' FORMATTED '  ) 


READ ( 20 , * ) NTOT 
CLOSE ( 20 ) 

NAME- ' REFMl 3 . FLR ' 
NJET_LAYERS-4 
NSIZE-1 28 

NFLG_FILE  -  0 
ROW_NUM-240 
COL_NUM-640 
NFR-0 


DO  L»1 , NTOT 

C  ZEROING  OUT  THE  TRANSFER  ARRAY 

DO  1-1,240 
DO  J-1,640 

XSUM(I, J)-0. 

END  DO 
END  DO 


DO  102  1-1 ,NJET_LAYERS 

C  ZEROING  OUT  THE  TRANSFER  ARRAY 

DO  IN-1,240 
DO  JN-1,640 

NJET( IN, JN)-0 
END  DO 
END  DO 

NH-NSIZE/2 

CALL  PIX_LOC( L,NX,NY,NFR,NTOT) 

I F ( NY . LT . 6  5 . OR . NY . GT .576)  THEN 
GOTO  523 
END  IF 
TYPE*, NX, NY 
NFR-1 

TYPE* , 'AT  SIZE' ,NSIZE, '  NAME  OF  FILE?' 
ACCEPT  30 ,NAMEIN 

CALL  GET  FLIR  IM( NAMEIN , NAR , 2 4 0 , 6 40 ) 


RP  -  NX-NH 

IF(RP.LT.O)  THEN 
RP  -  1 
END  IF 

DO  R-l , NSIZE 
CP  -  NY-NH 


DO  C-l, NSIZE 


NJET(RP,CP)-NAR(RP,CP) 

CP-CP+1 

END  DO 

RP-RP+1 

END  DO 

RP-NX-NH 
DO  R-l, NSIZE 
CP-NY-NH 
DO  C-l , NSIZE 

XJET( RP , CP ) - FLOAT ( NJET{ RP ,  CP ) ) 
CP-CP+1 
END  DO 
RP-RP+1 
END  DO 

RP-NX-NH 
DO  R-l, NSIZE 
CP-NY-NH 
DO  C-l , NSIZE 

XSUM ( RP , CP ) -XSUM ( RP , CP ) +X JET ( RP , CP ) 
CP-CP+1 
END  DO 
RP-RP+1 
END  DO 


CLOSE ( 10) 


DO  C-l, 640 
XTOP-O . 

DO  R-l, 240 

XT2-XSUM(R,C) 
RTOP-XTOP-XT2 
IF(RTOP.LT.O)  THEN 
XTOP-XT2 
END  IP 

END  DO 

TOP ( C ) -XTOP 

END  DO 

THEMAX-0. 

DO  C-l, 640 
XT3-TOP(C) 
RTOP-THE_MAX-XT3 
IF(RTOP.LT.O)  THEN 
THEMAX-XT3 
END  IF 


n  n  a  n  n  n 


END  DO 


RP-NX-NH 
DO  R-1,NSIZE 
CP-NY-NH 
DO  C-1,NSIZE 

XSUM( RP , CP ) -2  55 . * { XSUM ( RP , CP ) /THE_MAX ) 
NSUM(RP,CP)-IFIX(XSUM(RP,CP) ) 

CP-CP+1 
END  DO 
RP-RP+1 
END  DO 

NSIZE-NSIZE/2 
102  CONTINUE 


CALL  OUT  NAME ( NFLG  FI LE , NAMEOUT ) 


CALL  PUT_FL I R_I  M  { NAMEOUT , NSUM , NX , N Y , 2  4 0 , 6  4 0 ) 
NSIZE-128 

NFLG_FILE-NFLG_FILE+1 
523  END  DO 

30  FORMAT (A2 4 ) 

END 


C 


SIMILAR  TO  SUBROUTINE  FOUND  IN  BSG.FOR  ONLY  THE  NAMES  OF  THE 
OUTPUT  FILES  ARE  DIFFERENT. 


C 


SUBROUTINE  OUTNAME ( NFLG , NAMEOUT ) 

CHARACTER* 2 4  NAMEOUT 

IF(NFLG.EQ.O)  THEN 
NAMEOUT- ' JET1 . FLR ' 

ELSEI F( NFLG . EQ . 1 )  THEN 
NAMEOUT- ' JET2 . FLR • 
ELSEIF(NFLG.EQ.2)  THEN 
NAMEOUT- ' JET3 . FLR' 

ELSEI F ( NFLG . EQ . 3 )  THEN 
NAMEOUT- ' JET4 . FLR ' 

ELSEI F( NFLG. EQ. 4 )  THEN 
NAMEOUT- ' JET5 . FLR ' 

ELSEI F ( NFLG. EQ . 5 )  THEN 
NAMEOUT-' JET6. FLR' 

ELSEI F( NFLG. EQ. 6 )  THEN 
NAMEOUT-' JET 7. FLR' 

ELSEI F ( NFLG . EQ . 7 )  THEN 
NAMEOUT- ' JETS . FLR ' 

ELSEI F( NFLG . EQ . 8 )  THEN 


NAMEOUT- ' JET9 . FLR ' 
ELSEIF(NFLG. EQ • 9 )  THEN 
NAMEOUT- ' JET10 . FLR' 
ELSEIF(NFLG.EQ.IO)  THEN 
NAMEOUT- ' JET1 1 . FLR ' 
ELSEIF ( NFLG . EQ . 11 )  THEN 
NAMEOUT- ' JET1 2 . FLR ' 
ELSEIF ( NFLG . EQ . 12 )  THEN 
NAMEOUT- ' JET1 3 . FLR ' 
ELSEI F( NFLG . EQ . 1 3 )  THEN 
NAMEOUT-' JET14 .FLR' 
ELSEIF ( NFLG. EQ . 14 )  THEN 
NAMEOUT- ' JETl 5 . FLR' 
ELSEIF ( NFLG . EQ . 1 5 )  THEN 
NAMEOUT- ' JETl 6 . FLR ' 
ELSEI F( NFLG . EQ . 16 )  THEN 
NAMEOUT-' JET17 . FLR' 
ELSEIF (NFLG. EQ. 17 )  THEN 
NAMEOUT- ' JETl 8 . FLR ' 
ELSEIF(NFLG.EQ.18)  THEN 
NAMEOUT- •'  JETi.9  .  t  LR' 
ELSEI F ( NFLG. EQ . 19 )  THEN 
NAMEOUT- ' JET20 . FLR ' 
ELSEIF ( NFLG . EQ . 20 )  THEN 
NAMEOUT- ' JET21 . FLR' 
ELSEI F( NFLG. EQ. 21 )  THEN 
NAMEOUT- ' JET2  2 . FLR ' 
ELSEI F ( NFLG. EQ . 22 )  THEN 
NAMEOUT- ' JET2  3 . FLR ' 
ELSEI F ( NFLG . EQ .23)  THEN 
NAMEOUT- ' JET2  4 . FLR ' 
ELSEIF ( NFLG . EQ . 24 )  THEN 
NAMEOUT- ' JET25 . FLR' 
ELSEI F( NFLG. EQ. 25 )  THEN 
NAMEOUT- ' JET26 . FLR' 
ELSEIF ( NFLG . EQ . 26 )  THEN 
NAMEOUT- ' JET2  7 . FLR ' 
ELSEI F ( NFLG. EQ . 27 )  THEN 
NAMEOUT- ' JET28 . FLR ' 
ELSEI F ( NFLG . EQ . 28 )  THEN 
NAMEOUT- ' JET29 . FLR ' 
ELSEI F( NFLG. EQ. 29 )  THEN 
NAMEOUT- ' JET30 . FLR ' 
ELSEIF ( NFLG . EQ . 30 )  THEN 
NAMEOUT- ' JET31 . FLR' 

ELSE 

NAMEOUT- ' JET32 . FLR ' 
ENDIF 

RETURN 


END 


ooooonnoon 


SAME  AS  PUT  SUBROUTINE  FOUND  IN  BSG.FOR  WITH  THE  FOLLOWING 
DIFFERENCE: 


C 


ONLY  THE  PIXEL  VALUES  AROUND  A  PARTICULAR  JET  WILL  BE 

DISPLAYED,  AND  DISPLAYED  IN  THE  RELATIVE  POSITION  FOUND 

IN  THE  ORIGINAL  IMAGE  USING  THE  NX,  NY,  RP,  CP  POINTER  INDICATORS, 


- - 

SUBROUTINE  PUT_FLIR_IM( NAMEOUT , NMAG , NX , NY , ROW_NUM , COL_NUM ) 

IMPLICIT  INTEGER ( A-Z ) 

DIMENSION  NMAG (240,640) 

BYTE  NMAG_BYTE (240,640) 

CHARACTER* 2 4  NAMEOUT 

DO  R-1,240 
DO  C-l, 640 

NMAG_BYTE(R,C)-0 
END  DO 
END  DO 


TYPE*, 'WRITE  TO  FILE:  ' , NAMEOUT , ' START ' 

RP-NX-64 

IF(RP.LT.O)  THEN 
RP-1 
END  IF 
DO  R-1,128 

CP-NY-64 
DO  C-l, 128 

NMAG_BYTE( RP, CP ) -MOD ( NMAG ( RP ,CP) , 256 ) -128 
CP-CP+1 
END  DO 
RP-RP+1 
END  DO 

OPEN ( 20 , FILE-NAMEOUT , STATUS" ' NEW' , FORM- ' UNFORMATTED ' , 
+  RECL*COL_NUM/ 4+1 , RECORDTYPE" ' FIXED ' ) 

DO  100  R-l,ROW_NUM 

WRITE (20)  ( NMAG_BYTE ( R , C ) , C-l , COLNUM ) 

100  CONTINUE 

DO  R-1,256 
DO  C-l, 512 

NMAG(R,C)-0 
NMAG_BYTE ( R , C ) -0 
END  DO 
END  DO 

CLOSE( 20 ) 

TYPE*, 'WRITE  TO  FILE: 

RETURN 
END 


'  , NAMEOUT, 'COMPLETE' 


onono  o n o o n o o n o o o o o o o o o o o o o o o o 


THIS  SUBROUTINE  GIVES  PIXEL  LOCATIONS  PROVIDED  BY 
THE  THRESH_ADD_H 1ST  PROGRAM.  PIXEL  LOCATIONS  ARE 
READ  IN  FROM  A  FILE  CALLED  LFP.DAT. 

ARRAYS  USED: 

NLOCX  -  COLUMN  LOCATION 

NLOCY  -  ROW  LOCATION 

VARIABLES  USED: 

I,J  -  COORDINATE  LOCATION  OF  CENTROIDS 


ASCII  VARIABLES  USED: 

NONE 

WRITTEN  BY:  K.  W.  AYER,  CAPT,  USAF  DATE:  27  JULY  1989 

UPDATED  BY:  DATE: 


C 


SUBROUTINE  PIX  LOC ( NL 0 , NX , NY , NFR , NTOT ) 

DIMENSION  NLOCX( 10000) , NLOCY( 10000 ) 

OPEN ( 10 , FILE- ' LFP . DAT ' , STATUS- ' OLD' , FORM- ' FORMATTED ' ) 
IF(NFR.EQ.O)  THEN 


DO  L»1 , NTOT 

READ ( 1 0 , * ) I , J 
NLOCX ( L ) -I 
NLOCY ( L ) -J 
END  DO 
END  IF 

NX-NLOCX ( NDO ) 
NY-NLOCY ( NDO ) 

CLOSE ( 10 ) 

RETURN 

END 


C 


SAME  GET  IMAGE  SUBROUTINE  FOUND  IN  BSG.FOR 


C 


SUBROUTINE  GET  FLIR  I M ( NAME , AR , ROW_NUM , COL_NUM ) 
IMPLICIT  INTEGER ( A- Z ) 


BYTE 

DIMENSION 
CHARACTER* 2 4 


A«  BYTE! 240,640) 
ART  2  4  0,640) 

NAME 


OPEN ( 10 , FILE-NAME , STATUS- ' OLD ' , FORM- ' UNFORMATTED 
RECORDTYPE-' VARIABLE' ,ERR-20) 

OPEN ( 10 , FILE-NAME, STATUS-'OLD' , FORM- ' UNFORMATTED 
RECORDTYPE-' FIXED' ) 

TYPE*,  'SUCCESSFUL  FILE  OPEN' 

DO  100  R  -  1 , ROW_NUM 

READ(10)  (AR_BYTE(R,C) , C-l , COL_NUM ) 

CONTINUE 

TYPE*,  'SUCCESSFUL  FILE  READ' 

DO  R  -  1 , ROW_NUM 

DO  C  -  l,COL_NUM 

I F ( AR_B YTE ( R , C ) . LT . 0 ) THEN 
AR ( R , C )  -  AR_BYTE(R, C)+256 
ELSE 

AR ( R , C )  -  AR_BYTE(R,C) 

END  IF 

END  DO 

END  DO 
CLOSE( 10) 

RETURN 

END 


Appendix  H.  Jet  Vector  generating  FORTRAN  source  code. 


VECT  JETS. FOR 


SYNOPSIS:  The  VECT_JETS  program  constructs  20  (8)  dimensional 
vectors  from  the  coefficients  of  the  jets  made  by  the  JETS  program. 
The  vectors  are  associated  with  the  on  center  locations  determined 
by  the  SHOW_LAB_PLIR_IM  program. 


INPUT:  Jet  coefficients  from  the  JETS  program. 
OUTPUT:  Vector  set  matrix  for  input  into  MATRIX-X 


oooonnonnnnnononooooooooooooooonooooonnoonono 


PROGRAM  TO  FIND  THE  VECTOR  VERSION  OF  THE  JETS.  EACH  PIXEL 
WITHIN  THE  'FOVEAL'  REGION,  IE:  NEAR  THE  CENTER  OF  EACH  JET 
CORRESPONDS  TO  A  ( NORI ENT*NJET_LAYERS )  DIMENSIONAL  VECTOR. 
FROM  THIS  VECTOR,  CLASSIFICATION  MAY  BE  ATTEMPTED. 

ARRAYS  USED: 

NAR 
XAR 
NVECT 


RVECT 
RMATV 

VARIABLES  USED: 

NJET_LAYERS 
NOR I ENT 

NSIZE 
NFLG_FI LE 
NFR 

ROW_NUM 
COL_NUM 
NC 

NX,  NY 

ASCII  VARIABLES  USED: 

MATNAME  -  NAME  OF  MATRIX  CONSTRUCTED  OF  JET 

VECTORS 

LOCATION  -  NAME  OF  FILE  CONTAINING  THE  LOCATION 

OF  THE  CENTER  PIXELS  OF  THE  BLOBS 
TOTAL  -  NAME  OF  THE  FILE  CONTAINING  THE  TOTAL 

NUMBER  OF  VECTORS 


WRITTEN  BY:  F*”TN  W,  AYF° ,  CAPT,  USAF  DATE:  1  AUG  89 

UPDATED  BY:  KEVIN  W.  AYER,  CAPT,  USAF  DATE:  12  AUG  89 


C 


PROGRAM  VECT  MAIN 

DIMENSION  “  NAR (240,640) , XAR (240,640), NVECT (20) 

DOUBLE  PRECISION  TOP , RVECT< 8 ) , RMATV( 8 , 1 00 ) 

CHARACTER* 2  4  NAME IN , NAMEOUT , NAME , MATNAME , TOTAL , LOCATION 

CHARACTER* 2 4  NAMEl , NAME 2 , NAME 3 , NAME4 , NAMES , NAMES 

CHARACTER*  24  NAME 7 , NAME 8 , NAME 9 , NAMEl 0 , NAMEl 1 , NAMEl 2 

CHARACTER*  24  NAMEl 3 , NAMEl 4 , NAMEl 5 , NAME16 , NAMEl 7 , NAMEl 8 

CHARACTER*  2  4  NAME 19 , NAME 20 , NAME 2 1 , NAME 2 2 , NAME 2 3 , NAME 2 4 


-  NUMBER  OF  JET  LAYERS 

-  NUMBER  OF  ORIENTATIONS  WITHIN  EACH 
LAYER 

-  EXTENT  OF  LAYER 

-  OUTPUT  FILE  NAME  INDICATOR 

-  READ/NOREAD  LOCATIONS  INDICATOR 

-  NUMBER  OF  ROWS 

-  NUMBER  OF  COLUMNS 

-  VECTOR  ENTRY  LOCATION  INDICATOR 

-  LOCATIONS  OF  THE  CENTROIDS 


-  INTEGER  FORMAT  INPUT  IMAGE  ARRAY 

-  REAL  FORMAT  INPUT  IMAGE  ARRAY 

-  VECTOR  COMPRISED  OF  PIXEL  VALUES 
FROM  EACH  LAYER  AND  ORIENTATION 
ON  CENTER 

-  REAL  FORMAT  OF  NVECT 

-  REAL  FORMAT  MATRIX  FORM  OF  VECTORS 


INTEGER 


R , C , ROW  NUM , COL  NUM 


non 


1 


OPEN ( 42  , FILE-' VECT. DAT' , FORM- ' FORMATTED' , STATUS- ' NEW' ) 
CONTINUE 


TYPE*, 'WHAT  IS  THE  NAME  OF  THE  FILE  CONTAINING  THE  TOTAL' 
TYPE* , 'NUMBER  OF  VECTORS  GENERATED?' 

ACCEPT  30, TOTAL 

TYPE*, 'WHAT  IS  THE  NAME  OF  THE  FILE  CONTAINING  THE  LOCATIONS' 
TYPE*, 'OF  THE  CENTER  PIXELS  OF  THE  SEGMENTED  BLOBS?' 

ACCEPT  30, LOCATION 

NTOT  IS  A  VALUE  OBTAINED  BY  RUNNING  THE  SHOW_LAB_FLIR_IM  PROGRAM 

OPEN (20, FILE-TOTAL , STATUS- ' OLD ' , FORM- ' FORMATTED ' ) 

READ (20,*) NTOT 
CLOSE ( 20 ) 

TYPE*, 'WHAT  DO  YOU  WISH  TO  CALL  THE  MATRIX-X  OUTPUT  FILE?' 
ACCEPT  3  0 , MATNAME 

type* , 'NUMBER  OF  JET  LAYERS?' 

READ( 5, * )NJET_LAYERS 

TYPE*, 'NUMBER  OF  ORIENTATIONS  PER  LAYER?' 

READ( 5, * )NORIENT 

TYPE*, ' INITIAL  GABOR  WINDOW  SIZE?' 

READ( 5 , * )NSIZE 
NLOOP-NORIENT*NJET_LAYERS 
NFLGFILE  -  0 
NL-1 

ROWNUM-240 
COL_NUM-640 
NFR-0 
DUMMY- 0 . 


TYPE*, 'AT  SIZE  16,  NAME  OF  FILE?' 
ACCEPT  30 , NAMEl 

TYPE*, 'AT  SIZE  16,  NAME  OF  FILE?' 
ACCEPT  30 ,NAME2 

TYPZ* , 'AT  SIZE  16,  NAME  OF  FILE?' 
ACCEPT  3 0 , NAME 3 

TYPE*, 'AT  SIZE  16,  NAME  OF  FILE?' 
ACCEPT  30 , NAME 4 


TYPE*, 'AT  SIZE  8,  NAME  OF  FILE?' 
ACCEPT  30, NAMES 

TYPE*, 'AT  SIZE  8,  NAME  OF  FILE?' 
ACCEPT  30 , NAMES 

TYPE*, 'AT  SIZE  8,  NAME  OF  FILE?' 
ACCEPT  30 , NAME7 

TYPE*, 'AT  SIZE  8,  NAME  OF  FILE?' 


ACCEPT  3 0 , NAMES 


DO  L— 1 ,  N  i'OT 
DO  IN-1,20 

NVECT ( IN) -0 

END  DO 
NC-1 

DO  1-1 ,  NJET  T  e^ERS 

CALL  PIX" LOC ( LOCATION , L , NX , NY , NFR , NTOT ) 
I F ( N\ . uT . 65 . OR . NY . GT . 576 )  THEN 
GOTO  523 
END  IF 

TYPE*, 'ROW  ' , NX 
TYPE*, 'COLUMN  ' , NY 
NFR-1 

DO  IN-1, NORIENT 

IF(NC.EQ.l)  THEN 

NAME I N-NAME 1 

ELSEI F ( NC . EQ . 2 )  THEN 

NAME I N-NAME 2 

ELSEIF(NC.EQ.3)  THEN 

NAME I N-NAME 3 

ELSEI F ( NC . EQ . 4 )  THEN 

NAME I N-NAME 4 

ELSEI F ( NC . EQ . 5 )  THEN 

NAME I N-NAME 5 

ELSEI F { NC . EQ . 6 )  THEN 

NAME I N-NAME 6 

ELSEI F( NC . EQ . 7 )  THEN 

NAMEIN-NAME7 

ELSEIF(NC.EQ.S)  THEN 

NAMEIN-NAME8 

ELSEI F ( NC . EQ . 9 )  THEN 

NAME I N-NAME 9 

ELSEI F ( NC . EQ .10)  THEN 

NAMEIN-NAME10 

ELSEI F ( NC . EQ . 11 )  THEN 

NAMEIN-NAMEl 1 

ELSEIF(NC.EQ.12 )  THEN 

NAMEIN-NAMEl 2 

ELSEI F ( NC . EQ .13)  THEN 

NAMEIN-NAMEl 3 

ELSEI F ( NC . EQ . 14 )  THEN 

NAMEIN-NAMEl 4 

ELSEI F ( NC . EQ .15)  THEN 

NAMEIN-NAMEl 5 

ELSEI F ( NC . EQ . 16 )  THEN 

NAMEIN-NAMEl 6 

ELSEI F( NC . EQ. 17 )  THEN 

NAME I N-NAME 17 

ELSEI F ( NC . EQ . 18 )  THEN 

NAMEIN-NAMEl 8 

ELSEI F ( NC . EQ . 19 )  THEN 

NAME I N-NAME 19 

ELSE 

NAMEIN-NAME20 
END  IF 

CALL  GET  FLIR  IM( NAMEIN , NAR , 2 4 0 , 640 ) 
NVECT ( NCT-NARTNX , NY ) 


nooooooooonnnooonnooonooooo  noonn 


RVECT ( NC ) -DFLOAT ( NVECT ( NC ) ) 


WRITE ( 42,* ) RVECT (NC) 

NC-NC+1 
END  DO 

NSIZE-NSIZE/2 
END  DO 


type*, 'DO  YOU  WISH  TO  SCALE  THE  OUTPUT  BETWEEN' 
TYPE*, 'ZERO  AND  ONE,  LINEARLY?  NO-0,  YES-1' 

READ ( 5 , * ) NCHO 
I F ( NCHO . EQ . 1 )  THEN 
TOP-0 . 

DO  IT-1,8 

DI FF-TOP-RVECT ( IT) 

IF(DIFF.LT.O)  THEN 
TOP-RVECT( IT) 

END  IF 
END  DO 


XMIN-RVECT ( 1 ) 

DO  ITL-2,8 

XDI FF— XMIN— RVECT ( ITL ) 

I F ( XDI FF . GT . 0 )  THEN 
XMIN— RVECT( ITL) 

END  IF 
END  DO 

if ( top.eq.xmin)then 

top-top+xmin 

endi  f 

DO  IT-i , 8 

RVECT ( I T ) - ( RVECT (IT) -XMIN ) / ( TOP-XM IN ) 
END  DO 

END  IF 


DO  1-1,8 

RMATV ( I , NL ) -RVECT ( I ) 
END  DO 


NL-NL+1 

NFLG_FILE-NFLG_FILE+1 
NSIZE-1 28 
523  END  DO 


CALL  MATSAV ( 1 , MATNAME ,8,8, ntot , 0 , 
+  RMATV, DUMMY, '( 1P2E25.17)  '  ) 


lrPE*,'DO  YOU  WISH  TO  CONTINUE?  NO-0,  YES-1' 
READ ( 5, * )NBO 
IF(NBO.EQ.l)  THEN 
GOTO  1 
END  IF 
CLOSE ( 4 2  ) 


30  FORMAT (A2 4  ) 

END 

C - C 

C 

C  SAME  FORMAT  AS  PIX_LOC  FOUND  IN  JETS . FOR 

C 

C - c 


SUBROUTINE  PIX_LOC ( LOCNAME , NDO , NX , NY , NFR , NTO T ) 

DIMENSION  NLOCX( 10000) , NLOCY ( 1 0 000 ) 

CHARACTER* 2 4  LOCNAME 


OPEN ( 1 0 , FI LE-LOCNAME , STATUS- ' OLD ' , FORM- ' FORMATTED ' ) 


IF(NFR.EQ.O)  THEN 


DO  L— 1 , NTOT 

READ( 10 , * ) I , J 
NLOCX( L ) -I 
NLOCY ( L ) — J 
END  DO 
END  IF 

NX— NLOCX ( NDO ) 
NY-NLOCY ( NDO ) 

CLOSE ( 10) 

RETURN 

END 


C - C 

C 

C  SAME  GET  IMAGE  SUBROUTINE  AS  FOUND  IN  PREVIOUS  PROGRAMS 

C 

c - c 


SUBROUTINE  GET_FLIR  I M ( NAME , AR , ROW_NUM , COL_NUM ) 
IMPLICIT  INTEGER(S-Z) 

BYTE  AR  BYTE( 240,640) 

DIMENSION  ART 240,640) 

CHARACTER* 2 4  NAME 

OPEN ( 10, FILE-NAME, STATUS- 'OLD' , FORM- ' UNFORMATTED ' , 
+  RECORDTYPE-' VARIABLE' ,ERR-20) 

20  OPEN ( 1 0 , F I LE-NAME , STATUS- ' OLD ' , FORM- ' UNFORMATTED ' , 
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RECORDTYPE-' FIXED' ) 
TYPE* ,  'SUCCESSFUL  FILE  OPEN 


DO  100  R  -  1 , ROW_NUM 

READ (10)  ( AR_BYTE (  R  ,  C  )  , C*1 , COL  NUM) 

100  CONTINUE 


TYPE*,  'SUCCESSFUL  FILE  READ' 


DO  R  -  l,ROW_NUM  | 

DO  C  -  1 , COL_NUM  * 

I F ( AR_BYTE ( R , C ) . LT . 0 ) THEN 
AR { R , C )  -  AR_BYTE(R, C)+256 
ELSE 

AR( R, C )  -  AR_BYTE ( R , C ) 

END  IF 

END  DO 

END  DO  j 

CLOSE (10)  ] 

RETURN  J 

END  I 


SUBROUTINE  MATSAV  (  LUNIT,  NAME,  NR,  M,  N,  IMG, 
§  XREAL,  XIMAG,  FORMT  ) 


MATRIXx  TM  Software  V7 . 0  (C)  Copyright  1988 

INTEGRATED  SYSTEMS  INC.,  Santa  Clara,  California 

Published  Work.  Permission  is  granted  to  any  individual  or 
institution  to  modify,  copy  or  use  this  subroutine  except  for 
explicitly  commercial  purposes. 


MATSAV  writes  a  matrix  to  a  file  in  a  MATRIXx-readable  format.  It 
can  be  called  by  programs  that  want  to  write  data  to  MATRIXx. 

Files  written  with  MATSAV  can  be  read  into  MATRIXx  with  the  LOAD 
command. 


Param. 

1  Type 

(  On  input-  | 

On  output- 

LUNIT 

1 

j  INTEGER 

1  1 

|  Fortran  logical  unit  number.  | 

i  i 

unchanged. 

NAME 

|  CHARACTER* ( * ) 
j  (maximum 
j  length  10) 

1  1 

|  Name  of  the  matrix.  One  al-  i 

j  phabetic  followed  by  up  to  9  j 

j  alphanumeric  characters.  j 

i  l 

unchanged . 

NR 

!  INTEGER 

1 

1 

1  l 
|  Row-dimension  in  the  | 
j  defining  dimension  or  type  j 
j  statement  in  the  calling  j 

unchanged . 

onoriooononnrjooonoonoononnooonooononoooonoooooooooonoonnooooo 


1 

1 

|  program.  NR  must  be  greater 
|  than  or  equal  to  M. 

I 

M 

|  INTEGER 

|  Number  of  rows  of  the  matrix 

l 

unchanged . 

N 

|  INTEGER 

1 

1 

|  Number  of  columns  of  the 
j  matrix. 

I 

unchanged . 

IMG 

1 

j  INTEGER 

1 

1 

1 

1 

|  If  IMG  -  0,  the  imaginary 
(  part  ( XI MAG )  is  assumed  to 
j  be  zero  and  is  not  saved. 

unchanged . 

XREAL 

j  DOUBLE 
j  PRECISION 

l 

1 

(  Real  part  of  the  matrix  to 
j  be  saved. 

unchanged . 

XI  MAG 

1 

j  DOUBLE 
j  PRECISION 

I 

1 

(  Imaginary  part  of  the  matrix 

j  to  be  saved. 

1 

unchanged . 

FORMT 

1 

|  CHARACTER* ( * ) 
j  (maximum 
j  length  20) 

1 

1 

|  String  containing  the  For- 
(  tran  format  to  be  used  for 
|  writing  the  elements  of  the 
|  matrix. 

unchanged . 

1 

1 

1 

| 

|  For  machine-independent  files 
|  use  ' (1P2E25.17) ' 

1 

1 

1 

( 

|  For  machine-dependent  (fast, 
j  compact)  files  use  '(10A8)' 

|  or  '  ( 10Z16  ) ' 

Example:  The  following  Fortran  program  generates  a  simple 

identity  matrix  in  X  and  writes  it  to  Fortran  unit  1. 
Assume  that  unit  1  has  been  preallocated  as  file  (data 
set)  TEST. 

DOUBLE  PRECISION  X(20,3),  DUMMY 
DO  200  J-1,3 
DO  100  1-1,10 
X( I , J ) -0 . 0D0 
100  CONTINUE 

X( J, J)-1.0D0 
200  CONTINUE 

CALL  MATSAV(  1,  'AMATRIX' ,  20,  10,  3,  0, 

$  X,  DUMMY,  ' (1P2E25.17) '  ) 

STOP 

END 


After  this  program  runs,  invoke  MATRIXx  and  type: 

<>  LOAD  'TEST' 

This  will  put  X  on  the  stack  as  a  variable  named  AMATRIX. 

When  the  objective  is  to  convert  a  file  written  by  another  soft¬ 
ware  package  into  a  MATRIXx- readable  file,  you  will  have  to  write 
a  small  program  that  reads  the  data  in  using  the  format  of  the 


ooo  non  noon  non 


|  other  software  package  then  writes  it  out  by  calling  MATSAV. 


INTEGER  LUNIT,  M,  N,  NR,  IMG 

CHARACTER* ( * )  NAME,  FORMT 

DOUBLE  PRECISION  XREAL ( NR , * ) ,  XI MAG ( NR , * ) 

CHARACTER  NAM*10,  FORM*20 


write  header  record. 


NAM-NAME 

FORM-FORMT 

OPEN ( LUNIT , FI LE-NAM , STATUS- ' NEW ' ) 

WRITE( LUNIT, ' ( A10 , 315 ,A20 ) ' )  NAM, M,N, IMG, FORM 


1  write  real-part  of  the  matrix. 


WRITE( LUNIT, FORM)  ( ( XREAL ( I , J ) , 1-1 , M ) , J-l , N ) 


|  write  imaginary-part  if  nonzero. 


IF(IMG.NE.O)  WRITE( LUNIT, FORM)  ( ( XI MAG ( I , J ) ,1-1, M) ,J-1,N) 

CLOSE( LUNIT) 

RETURN 

END 


Appendix  I.  MATRIX-X  code  for  generating  the  Minkowski -2  Space 
Distances . 

CORR.MXE 


SYNOPSIS S  The  CORR.MXE  program  is  a  MATRIX-X  readable  code  that 
calculates  the  Minkowski  two,  or  Euclidean,  distance  between  vectors 
generated  by  the  VECT_JBTS  program.  Each  vector  from  a  given  image 
is  put  together  in  such  a  way  as  to  make  a  matrix  X  by  20  (or  X  by 
8).  An  exemplar  matrix  is  used  which  is  comprised  of  one  of  the 
vector  sets  generated  by  the  VECT_JETS  program.  Each  vector  is  then 
compared  to  the  exemplar  set  using  the  Minkowski  two  space  distance 
rule. 

EXAMPLE:  Let  the  exemplar  vector  set  make  a  7  by  8  matrix,  seven 
vectors  each  having  8  components.  A  test  vector  set  makes  a  14  by 
8  matrix,  14  vectors  each  having  8  components.  The  resulting 
distance  matrix  will  be  14  by  7,  where  each  component  of  the 
distance  matrix  is  the  compared  distance  between  vectors  of  the 
exemplar  set  and  the  test  vector  set. 


INPUT:  Vector  sets  converted  into  MATRIX-X  format. 

OUTPUT:  Distance  matrix  between  the  exemplar  vector  set  and  test 
vector  set. 
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**  hirit  it  ***********  it  irk  it  ******  it  *********  it  ********  it  it  ********************* 
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* 
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* 
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* 
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it 

it 

* 
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* 

* 
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* 

* 

* 
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CORR.MXE.  MATRIX-X  code  for  calculating  the  Euclidean 
distance  between  vectors  generated  from  the  VECT_JETS  program. 

ARRAYS  USED: 

C(i,k)  -  Matrix  of  distances 

A(i,j)  ~  Matrix  made  from  test  vectors 

B(j,k)  -  Matrix  made  from  exemplar  vectors 

VARIABLES  USED: 


rows  -  Number  of  rows  associated  with  test 

matrix 

cols  -  Number  of  cols  associated  with 

exemplar  matrix 


ASCII  VARIABLES  USED: 


None 


Written  by:  Kevin  W.  Ayer.  Capt,  USAP  DATE:  14  Aug  89 
Updated  by:  DATE: 


******************************************************************** 
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The  following  is  the  basic  code  for  vector  comparison.  For  specific 
code,  refer  to  C0RR1.MXE  or  C0RR2.MXE. 


POR  i  =  1  :  rows  ; . . . 

FOR  k  =  1  :  cols  ; . . . 

C(i ,k)  =0  ; . . . 

por  j  =  l  :  8 

C(i,k)  =  C(i,k)  ♦  (  A(i,j)  -  B(j,k)  )  **  2  ;... 
END  ; . . . 

C(I,k)  =  SQRT  (  C(i ,k)  ) 


END  ; . . . 

END 

[NOTE:  HATRK24(j,k) ,  MATRM13( j,k)  or  MATRM14(j,k)  is  substituted 
for  B(j,k)  depending  on  the  data  set  used.  CORRt.MXR  uses 
MATRM19( j,k)  and  CORR2.MXE  uses  MATRK24(j,k)  as  template  vector 
sets] 
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C  I  other  software  package  then  writes  it  out  by  calling  MATSAV. 


C 

INTEGER  LUNIT,  M,  N,  NR,  IMG 

CHARACTER* (* )  NAME,  FORMT 

DOUBLE  PRECISION  XREAL ( NR , * ) ,  XIMAG( NR, * ) 

CHARACTER  NAM*10,  FORM*20 


|  write  header  record. 


NAM-NAME 

FORM-FORMT 

OPEN( LUNIT, FILE-NAM, STATUS* ' NEW' ) 

WRITE ( LUNIT, ' ( A10 , 3! 5 , A20 ) ' )  NAM, M , N , IMG, FORM 


|  write  real-part  of  the  matrix. 


WRITE ( LUNIT, FORM)  ( ( XREAL ( I , J ) , 1-1 , M ) , J-l , N) 


|  write  imaginary-part  if  nonzero. 


IF( IMG.NE. 0 )  WRITE( LUNIT, FORM)  ( ( XIMAG( I , J ) , 1-1 , M ) , J-l ,N ) 

CLOSE ( LUNIT ) 

RETURN 

END 


Appendix  I.  MATRIX-X  code  for  generating  the  Minkowski-2  Space 
Distances. 

CORR.MXE 


SYNOPSIS:  The  CORR.MXE  program  is  a  MATRIX-X  readable  code  that 
calculates  the  Minkowski  two.  or  Euclidean,  distance  between  vectors 
generated  by  the  VECT_J8TS  program.  Each  vector  from  a  given  image 
is  put  together  in  such  a  way  as  to  make  a  matrix  X  by  20  (or  X  by 
8).  An  exemplar  matrix  is  used  which  is  comprised  of  one  of  the 
vector  sets  generated  by  the  VECT_JETS  program.  Each  vector  is  then 
compared  to  the  exesplar  set  using  the  Minkowski  two  space  distance 
rule. 

EXAMPLE:  Let  the  exemplar  vector  set  make  a  7  by  8  matrix,  seven 
vectors  each  having  8  components.  A  teat  vector  set  makes  a  14  by 
8  matrix,  14  vectors  each  having  8  components.  The  resulting 
distance  matrix  will  be  14  by  7,  where  each  component  of  the 
distance  matrix  is  the  compared  distance  between  vectors  of  the 
exemplar  set  and  the  test  vector  set. 


INPUT:  Vector  sets  converted  into  MATRIX-X  format. 

OUTPUT:  Distance  matrix  between  the  exemplar  vector  set  and  test 

vector  set. 
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******************************************************************** 

* 

* 


* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 
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* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 

* 
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CORR.MXE.  MATRIX-X  code  £or  calculating  the  Euclidean 
distance  between  vectors  generated  from  the  VECT_JETS  program. 

ARRAYS  USED: 

C(i,k)  -  Matrix  of  distances 

A(i,j)  -  Matrix  made  from  test  vectors 

B(j,k)  -  Matrix  made  from  exemplar  vectors 

VARIABLES  USED: 

rows  -  Number  of  rows  associated  with  test 

matrix 

cols  -  Number  of  cols  associated  with 

exemplar  matrix 

ASCII  VARIABLES  USED: 

None 

Written  by:  Kevin  W.  Ayer.  Capt,  USAF  DATE:  14  Aug  89 
Updated  by:  DATE: 


******************************************************************** 
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The  following  is  the  basic  code  for  vector  comparison.  For  specific 
code,  refer  to  C0RR1.MXB  or  C0RR2.MXE. 

FOR  i  =  1  :  rows  ; . . . 

FOR  k  =  1  :  cols  ; . . . 

c(i,k)  =  0 

for  j  =  l  :  8 

C(i ,k)  =  C(i ,k)  ♦  (  A(i,j)  -  B(j,k)  )  **  2 
END  ; . . . 

C(I,k)  =  SQRT  (  C(i ,k)  ) 

END  ; . . . 

END 

[NOTE:  MATRK24( j,k),  MATRM13( j,k)  or  MATRM14(j,k)  is  substituted 
for  B(j,k)  depending  on  the  data  set  used.  CORR1.MXB  uses 
MATRM19(j,k)  and  CORR2.MXE  uses  MATRK24(j,k)  as  template  vector 
sets] 


FOR  1-1 : ROWS ; . . . 

FOR  K-l : COLS ; . . . 

C( I ,K)«0;  .  .  . 

FOR  J-l : 8 ; .  .  . 

C( I,K)-C( I,K)+(A( I  ,  J  ) -MATRJ19 (  J  ,  K  ) )**2 
END ; .  .  . 

C(I,R)-SQRT(C(I,K) ) ; . .  . 

END ; . .  . 

END ; .  .  . 

NUM-7 ; . . . 

FOR  L-l : 6  ; .  .  . 

FOR  1-1 : ROWS ; . . . 

MIN(L,I)-5. ; . . . 

FOR  K-l :COLS; . . . 

DIFF-  MIN ( L , I )  -  C( I ,K) ; . . . 

IF  DIFF>0,MIN(L,I)«C(I,K) ; END; . . . 

IF  DIFF>0 , LOC“K ; END ; . . . 

END ; . .  . 

C(IfLOC)-100.  ;  .  .  . 

MIN( NUM, I )-LOC; . . . 

END ; . . . 

NUM-NUM+1 ; . . . 

END ; . .  . 

FOR  1-2:6; .  .  . 

IMl-I-1 ;  .  .  . 

FOR  J-l :ROWS; . . . 

FOM( IM1 , J ) -MIN( I , J )/MIN( 1 , J ) ; . . . 

END;  .  .  . 

END ; . . . 


FOR  1-1 :  ROWS  ;  .  .  . 

FOR  K— 1 : COLS ; . . . 

C(I,K)-0; . . . 

FOR  J-l : 8 ; . . . 

C(I,K)-C(I,K)+(A( I , J ) -MATRMl 3  (  J  ,  K  ) ) **2 
END ; . . . 

C(I,K)-SQRT(C(I,K) ) ; . . . 

END; . . . 

END ;  .  .  . 

NUM-7; . . . 

FOR  L-l : 6  ;  .  .  . 

FOR  1-1 : ROWS ; . . . 

MIN(L,I)-5. ; . . . 

FOR  K-l : COLS ; . . . 

DIFF-  MIN( L , I )  -  C ( I , K ) ; . . . 

IF  DIFF>0,MIN(L,I)-C( I,K) ; END ; . . . 

IF  DIFF>0 , LOC-K ; END ; . . . 

END ; . . . 

C(I,LOC)-100. ; .  .  . 

MIN ( NUM , I ) «LOC ; . . . 

END; . . . 

NUM-NUM+1; . . . 

END ;  .  .  . 

FOR  1*2:6;... 

IMl-I-1 ;  .  .  . 

FOR  J-l  .-ROWS;  .  .  . 

FOM( IMl , J ) -MIN( I , J )/MIN ( 1 , J ) ; . . . 

END; .  .  . 

END ;  .  .  . 


Appendix  J.  Making  a  hard  copy  of  displayed  images. 


Paper  copies  of  Gabor  filtered  images  are  produced  on  the  SUN 
4.0  Workstation  computer  system  using  the  gray  scale  technique.  The 
gray  scale  technique  involved  converting  the  pixel  values  of  the 
images  generated  on  the  VAX  Workstation  to  0  or  255  using  a  program 
called  HT0NE2,  an  ADA  coded  program  provided  by  Capt  Dennis  Ruck. 
Bach  image  file  had  to  be  converted  to  a  standard  binary  format 
using  the  VAX  system  command  CONVBRT/FDL=f ilename .  The  filename  is 
an  image  file  with  specific  characteristics  which  remove  all  record 
specific  parameters  such  as  record  length,  record  size,  carriage 
controls,  etc.,  prior  to  transfer  to  the  UNIX  based  Sun  4.0 
Workstation.  The  standard  binary  files  are  transferred  from  the 
VAXStation-3  system  to  the  SUN  4.0  Color  Workstation  system.  Note 
that  the  SUN  4.0  Workstation  MUST  be  a  Color  Station  for  the  program 
to  work.  Once  the  image  files  are  transferred  to  the  Sun  4.0 
Workstation,  the  images  are  converted  to  a  PIXRECT  format  for  image 
display  on  the  screen.  The  screen  display  of  the  images  is  then 
converted  to  a  raster  file  for  transfer  using  a  capture  routine 
provided  by  Capt  Dennis  Ruck.  The  capture  routine  requires  known 
x  and  y  extent  of  the  PIXRECT  converted  images.  The  resulting 
rastered  images  are  then  sent  to  a  laser  printer  for  hard  copy. 

An  alternative  method  for  generating  images  uses  a  binary  to  TIPP 
conversion  routine  called  PLR2TIF,  written  in  C-Language  code  by 
Capt  John  Cline.  The  images  created  on  the  VAXStation-3  system  are 
converted  in  a  similar  fashion  as  the  Ruck  algorithm  and  sent  to  the 
SUN  4.0  system.  The  iawges  are,  then,  transferred  to  a  personal 
computer  (PC,  Z-248)  for  conversion  from  binary  to  TIPP.  FLR2TIP 
produces  an  8  bit  grey  scale  iawge  as  opposed  to  4  bit  (HT0NR2). 
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Appendix  K.  Schematic  of  Gabor  Based 
Segmentation  and  Classification  Program. 


Legend : 

Dotted  line  boxes  represent  separate  programs. 
Solid  boxes  represent  decision  nodes. 

Octagons  represent  input  nodes . 

Diamonds  represent  output  nodes . 


Input  raw  FLIR  image  consisting  of  240  by  640  pixels. 

Decision  requested  for  classification  or  segmentation. 

If  classification  is  requested,  program  executes  self  similar  Gabor 
function  subroutine.  Screen  display  of  self  similar  Gabor 
transformed  FLIR  image  is  an  option  at  this  point  in  the  program. 

If  segmentation  is  requested,  program  executes  non-self  similar 
Gabor  function  subroutine.  Screen  display  of  non-self  similar  Gabor 
transformed  FLIR  image  is  an  option  at  this  point  in  the  program. 

Segmentation.  Once  the  non-self  similar  Gabor  filtered  images  are 
generated,  they  are  processed  by  an  algorithm  which  superimposes 
them.  The  superimposed  images  are  histograsned  based  on  the 
individual  pixel  values,  which  correspond  to  image  intensity.  A 
threshold  is  established  based  on  the  intensity  distribution 
(histogram).  Segmentation  is  considered  complete  at  this  point. 


Classification.  The  self  similar  Gabor  transformed  images  establish 
the  data  set  from  which  the  Gabor  coefficients  for  foveal  views  are 
generated.  They  also  comprise  the  data  set  from  which  the  jet 
vectors  will  be  generated. 

The  segmented,  thresholded  versions  of  the  FLIR  images  are 
processed  by  an  algorithm  that  finds  the  centroids  of  the  segmented 
"blobs".  From  these  centroid  locations,  jet  vectors  will  be 
constructed.  The  vectors  (jets)  are  concatenated  into  a  MATRIX-X 
readable  file  for  test  to  exemplar  comparison.  Classification  is 
completed  at  this  point. 
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Appendix  L.  Equipment  and  resource  listing. 


1 .  Computer  Resources . 

a.  Sun  4.0  Workstations  UNIX  Computer  Systems. 

1)  Graphics  Sun  Workstation. 

AFIT,  Bldg.  640,  Room  243. 

2)  Array  Multiplier  Sun  Workstation. 

AFIT,  Bldg.  640,  Room  243. 

b.  VAX  VMS  Computer  Systems. 

AFIT,  Bldg.  642,  Signal  Processing  Lab  (Rm.  2011) 

c.  Personal  Computer  (PC)  Resources. 

Zenith  248  PC  computers. 

AFIT,  Bldg.  640,  Room  243. 

d.  AFIT  school  computers  (Names  are  acronyms  for  the 
mainframe 

computers  available  at  AFIT). 

1)  CSC. 

2)  ICC. 

2.  Other  resources. 

Human  Bioengineering  Laboratories,  Bldg.  248,  Wright- 
Patterson  AFB,  OH,  Area  B.,  contact:  Dr.  Mark  Cannon  and  Mr.  Steve 
Pullencamp. 
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Appendix  M.  Increasing  the  sinusoidal  variation 
under  the  self  similar  Gaussian  Cofactor. 

A  novel  approach  for  combining  the  segmentation  capabilities 
of  non-self  similar  Gabor  functions  with  the  ease  of  generating 
dilating  Gabor  functions  (self  similar)  is  presented.  This  approach 
introduces  the  notion  of  a  user  definable  number  of  cycles  under  the 
Gaussian  envelope  coupled  with  dilating  the  function  via  changing 
the  Gabor  window  size.  Care  nuat  be  taken  to  ensure  near  zero  Gabor 


Figure  AM-1.  Effect  of  increasing  the  number  of  cycles 
under  the  Gaussian  envelope  of  a  self  similar  Gabor 
function.  Binarised  version  of  modified  Gabor 
transformed  image.  Note  the  complete  boundaries  around 
the  targets. 
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function  values  at  the  maxima  extent  of  the  Gabor  window,  thereby 
reducing  the  effect  of  Gabor  function  windowing.  Figure  AM-1  shows 
the  effects  of  increasing  the  number  of  cycles  under  the  self 
similar  Gabor  function's  Gaussian  envelope.  As  is  clearly  evident 
in  Figure  AM-1,  by  modifying  the  traditional  "one  cycle"  self 
similar  Gabor  function,  segmentation  is  possible.  Note  the  complete 
to  near  complete  boundaries  around  the  targets  within  the  Gabor 
processed  FLIR  image. 
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Appendix  N.  Grossberg's  Boundary  Contour-Peature  Contour  System 
(8:87-116). 

In  a  series  of  papers,  Grossberg  describes  an  interactive 
system  that  establishes  boundaries  around  an  object  of  interest, 
then  completes  the  region  surrounded  by  the  boundaries. 

This  hybrid  system  is  referred  to  as  the  Boundary  Contour- 
Peature  Contour  System  (BC-PC  system).  Through  the  interaction  of 
the  boundary  contour  system  with  the  feature  contour  system, 
boundary  completion  and  segmentation  occur  earlier  in  image 
processing. 

The  output  of  the  boundary  contour  system  stage  are  fill-in 
generator  (PIGs)  and  fill-in  barriers  (PIBs)  which  feed  into 
parallel  feature  contour  system  stages:  a  monocular  and  a  binocular 
stage. 

The  monocular  feature  contour  stage  suppresses  prohibitive  or 
inconsistent  monocular  color  and  brightness  signals  while  the 
binocular  PC  stage  performs  a  similar  task  for  inconsistent 
binocular  color  and  brightness  signals.  The  signals  which  survive 
this  multiple  filtering  stage  act  to  fill  in  only  those  regions 
possessing  monocular  and  binocular  consistent  signals. 

Grossberg's  monocular  and  binocular  theories,  based  on  the 
boundary  contour-feature  contour  system,  model  how  chromatically 
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broadband  cortical  complex  cells  adaptively  tune  to  process 
information  about  position,  orientation,  spatial  frequency, 
positional  disparity,  and  orientational  disparity. 
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Appendix  0.  Lambert  preprocessing  of  FLIR  images  (15). 


The  primary  purpose  of  "Lambertizing"  an  image  is  to  eliminate 
the  dependency  most  processes  have  on  image  intensity.  The  Gabor 
transform  is  not  immune  to  image  intensities.  Therefore,  in  an 
effort  to  eliminate  the  image  intensity  dependency,  the  raw  FLIR 
images  were  subjected  to  "Lambertization" . 

Lambert izat ion  involves  computing  the  local  average  intensity 
about  a  central  location,  subtracting  the  local  average  intensity 
from  the  central  location  intensity,  then  adding  this  computed  value 
to  a  set  intensity  value 

Hew  Pixel  Value  =  128  ♦  (Center  Pixel  Value  -  Local  Average)  (16) 

Note  that  the  new  pixel  value  will  be  different  from  128  by 
the  difference  between  the  center  pixel  value  and  its  corresponding 
local  average.  Hence  the  resulting  image  will  be  independent  of 
global  and  local  intensities,  comprised  of  pixel  intensity  values 
deviating  about  a  set  pixel  value,  128. 

Figure  AO-1  shows  the  effect  of  "Lambertizing"  FLIR  image 
REFK41.PLR.  As  is  evident  in  figure  AO-1,  "Lambertizing"  the  FLIR 
image  introduces  severe  corruption  of  the  image.  However,  this 
corruption  is  not  detrimental  to  the  Gabor  transformation  process. 


Figure  AO-1.  Effects  of  "Lambertizing"  FLIR  image 
REFK41.PLR.  The  top  image  is  the  original  FLIR  image. 
The  bottom  image  is  the  Lambert  version.  Note  the 
clutter  introduced  by  Lambertization. 
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Figure  AO-3.  a.  Lambert i cation  of  test  image. 
Outlining  of  rectangles  within  original  test  image,  b. 
Original  test  image,  RFCT_THST.DAT.  Lambertication 
provides  indication  of  boundaries  between  low  intensity 
regions. 


process  distinguishes  the  boundary  between  the  background  (pixel 
value:  0)  and  the  rectangle  (pixel  value:  10). 

The  automatic  thresholding  algorithm  developed  for  this 
research  was  designed  for  Gabor  transformation  and  not  for 
preprocessed,  "Lambertized",  Gabor  transformation. 

Therefore,  the  thresholding  process  will  produce  more  distinct 
regions  of  interest  for  non-preprocessed  Gabor  transformed  images 
chan  for  Lambertized  Gabor  transformed  images  (Figures  A0-4a  and  b). 
As  can  be  seen  in  figure  A0**4a,  the  edges  of  the  targets  within  the 
PL1R  image  are  more  distinct  when  no  preprocessing  is  performed. 
These  results  are  typical  of  processing  the  FLIR  images  using  only 
Gabor  transformation  techniques  versus  those  using  preprocessing, 
"Lambertizing",  techniques. 
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Figure  AO-2  shows  the  effects  of  Gabor  transforming  the 
"Lambert i zed"  version  of  PLIR  image  REPK41.FLR.  The  results  of 
"Lambertization"  are  inconclusive  using  the  image  set  fcr  this 
research  primarily  because  of  the  lack  of  dim  targets  in  this  set 
of  images.  Lambertization  works  well  for  images  possessing  objects 


Figure  AO-2.  Gabor  transformation  of  "Lambert i zed" 
version  of  FLIR  image  REFK41.FLR  (frequency:  3, 
orientations:  0  and  90  degrees).  Lambertization 
reduces  the  effectiveness  of  Gabor  transforms  used  for 
this  thesis. 


with  widely  varying  illumination  (Figures  AO- 3a  and  b) .  The 
rectangles  along  the  right  side  of  the  second  block  of  rectangles 
are  barely  detectable  in  this  image.  However,  the  Lambertization 
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Pigure  AO-4.  a.  Oabor  transformation  of  PLIR  image 
REFK41.PLR  (No  Lambertisation) .  b.  Oabor 
transformation  of  PLIR  image  REPK41.PLR  (After 
Lambertisation).  Lambertisation  reduces  effectiveness 
of  Oabor  transformation  used  in  this  thesis. 
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